01538nas a2200169 4500008004200000245012100042210006900163520094900232100001801181700001701199700002501216700001801241700002201259700002201281700002001303856004501323 In Press d 00aDevelopment of a Computerized Adaptive Test for Anxiety Based on the Dutch–Flemish Version of the PROMIS Item Bank0 aDevelopment of a Computerized Adaptive Test for Anxiety Based on3 aWe used the Dutch–Flemish version of the USA PROMIS adult V1.0 item bank for Anxiety as input for developing a computerized adaptive test (CAT) to measure the entire latent anxiety continuum. First, psychometric analysis of a combined clinical and general population sample (N = 2,010) showed that the 29-item bank has psychometric properties that are required for a CAT administration. Second, a post hoc CAT simulation showed efficient and highly precise measurement, with an average number of 8.64 items for the clinical sample, and 9.48 items for the general population sample. Furthermore, the accuracy of our CAT version was highly similar to that of the full item bank administration, both in final score estimates and in distinguishing clinical subjects from persons without a mental health disorder. We discuss the future directions and limitations of CAT development with the Dutch–Flemish version of the PROMIS Anxiety item bank.1 aFlens, Gerard1 aSmits, Niels1 aTerwee, Caroline, B.1 aDekker, Joost1 aHuijbrechts, Irma1 aSpinhoven, Philip1 ade Beurs, Edwin uhttps://doi.org/10.1177/107319111774674201462nas a2200121 4500008003900000245009900039210006900138300001100207490000700218520105100225100001901276856004501295 2020 d00aFramework for Developing Multistage Testing With Intersectional Routing for Short-Length Tests0 aFramework for Developing Multistage Testing With Intersectional  a87-1020 v443 aMultistage testing (MST) has many practical advantages over typical item-level computerized adaptive testing (CAT), but there is a substantial tradeoff when using MST because of its reduced level of adaptability. In typical MST, the first stage almost always performs as a routing stage in which all test takers see a linear test form. If multiple test sections measure different but moderately or highly correlated traits, then a score estimate for one section might be capable of adaptively selecting item modules for following sections without having to administer routing stages repeatedly for each section. In this article, a new framework for developing MST with intersectional routing (ISR) was proposed and evaluated under several research conditions with different MST structures, section score distributions and relationships, and types of regression models for ISR. The overall findings of the study suggested that MST with ISR approach could improve measurement efficiency and test optimality especially with tests with short lengths.1 aHan, Kyung, T. uhttps://doi.org/10.1177/014662161983722601760nas a2200145 4500008003900000245008000039210006900119300000900188490000700197520132100204100001601525700001501541700001301556856004501569 2020 d00aNew Efficient and Practicable Adaptive Designs for Calibrating Items Online0 aNew Efficient and Practicable Adaptive Designs for Calibrating I a3-160 v443 aWhen calibrating new items online, it is practicable to first compare all new items according to some criterion and then assign the most suitable one to the current examinee who reaches a seeding location. The modified D-optimal design proposed by van der Linden and Ren (denoted as D-VR design) works within this practicable framework with the aim of directly optimizing the estimation of item parameters. However, the optimal design point for a given new item should be obtained by comparing all examinees in a static examinee pool. Thus, D-VR design still has room for improvement in calibration efficiency from the view of traditional optimal design. To this end, this article incorporates the idea of traditional optimal design into D-VR design and proposes a new online calibration design criterion, namely, excellence degree (ED) criterion. Four different schemes are developed to measure the information provided by the current examinee when implementing this new criterion, and four new ED designs equipped with them are put forward accordingly. Simulation studies were conducted under a variety of conditions to compare the D-VR design and the four proposed ED designs in terms of calibration efficiency. Results showed that the four ED designs outperformed D-VR design in almost all simulation conditions.1 aHe, Yinhong1 aChen, Ping1 aLi, Yong uhttps://doi.org/10.1177/014662161882485401777nas a2200145 4500008003900000245005500039210005400094300001300148490000700161520135000168100001901518700002601537700002301563856004501586 2019 d00aDeveloping Multistage Tests Using D-Scoring Method0 aDeveloping Multistage Tests Using DScoring Method a988-10080 v793 aThe D-scoring method for scoring and equating tests with binary items proposed by Dimitrov offers some of the advantages of item response theory, such as item-level difficulty information and score computation that reflects the item difficulties, while retaining the merits of classical test theory such as the simplicity of number correct score computation and relaxed requirements for model sample sizes. Because of its unique combination of those merits, the D-scoring method has seen quick adoption in the educational and psychological measurement field. Because item-level difficulty information is available with the D-scoring method and item difficulties are reflected in test scores, it conceptually makes sense to use the D-scoring method with adaptive test designs such as multistage testing (MST). In this study, we developed and compared several versions of the MST mechanism using the D-scoring approach and also proposed and implemented a new framework for conducting MST simulation under the D-scoring method. Our findings suggest that the score recovery performance under MST with D-scoring was promising, as it retained score comparability across different MST paths. We found that MST using the D-scoring method can achieve improvements in measurement precision and efficiency over linear-based tests that use D-scoring method.1 aHan, Kyung, T.1 aDimitrov, Dimiter, M.1 aAl-Mashary, Faisal uhttps://doi.org/10.1177/001316441984142801544nas a2200145 4500008003900000245009800039210006900137300001200206490000700218520104000225100002901265700002501294700003401319856004501353 2019 d00aImputation Methods to Deal With Missing Responses in Computerized Adaptive Multistage Testing0 aImputation Methods to Deal With Missing Responses in Computerize a495-5110 v793 aRouting examinees to modules based on their ability level is a very important aspect in computerized adaptive multistage testing. However, the presence of missing responses may complicate estimation of examinee ability, which may result in misrouting of individuals. Therefore, missing responses should be handled carefully. This study investigated multiple missing data methods in computerized adaptive multistage testing, including two imputation techniques, the use of full information maximum likelihood and the use of scoring missing data as incorrect. These methods were examined under the missing completely at random, missing at random, and missing not at random frameworks, as well as other testing conditions. Comparisons were made to baseline conditions where no missing data were present. The results showed that imputation and the full information maximum likelihood methods outperformed incorrect scoring methods in terms of average bias, average root mean square error, and correlation between estimated and true thetas.1 aCetin-Berber, Dee, Duygu1 aSari, Halil, Ibrahim1 aHuggins-Manley, Anne, Corinne uhttps://doi.org/10.1177/001316441880553202022nas a2200193 4500008003900000245010500039210006900144300001200213490000700225520140200232100002301634700001901657700001801676700002101694700002201715700002801737700001801765856004501783 2019 d00aAn Investigation of Exposure Control Methods With Variable-Length CAT Using the Partial Credit Model0 aInvestigation of Exposure Control Methods With VariableLength CA a624-6380 v433 aThe purpose of this simulation study was to investigate the effect of several different item exposure control procedures in computerized adaptive testing (CAT) with variable-length stopping rules using the partial credit model. Previous simulation studies on CAT exposure control methods with polytomous items rarely considered variable-length tests. The four exposure control techniques examined were the randomesque with a group of three items, randomesque with a group of six items, progressive-restricted standard error (PR-SE), and no exposure control. The two variable-length stopping rules included were the SE and predicted standard error reduction (PSER), along with three item pools of varied sizes (43, 86, and 172 items). Descriptive statistics on number of nonconvergent cases, measurement precision, testing burden, item overlap, item exposure, and pool utilization were calculated. Results revealed that the PSER stopping rule administered fewer items on average while maintaining measurement precision similar to the SE stopping rule across the different item pool sizes and exposure controls. The PR-SE exposure control procedure surpassed the randomesque methods by further reducing test overlap, maintaining maximum exposure rates at the target rate or lower, and utilizing all items from the pool with a minimal increase in number of items administered and nonconvergent cases.1 aLeroux, Audrey, J.1 aWaid-Ebbs, Kay1 aWen, Pey-Shan1 aHelmer, Drew, A.1 aGraham, David, P.1 aO’Connor, Maureen, K.1 aRay, Kathleen uhttps://doi.org/10.1177/014662161882485601810nas a2200133 4500008003900000245010200039210006900141300001200210490000700222520136300229100001901592700002001611856004501631 2019 d00aMultidimensional Computerized Adaptive Testing Using Non-Compensatory Item Response Theory Models0 aMultidimensional Computerized Adaptive Testing Using NonCompensa a464-4800 v433 aCurrent use of multidimensional computerized adaptive testing (MCAT) has been developed in conjunction with compensatory multidimensional item response theory (MIRT) models rather than with non-compensatory ones. In recognition of the usefulness of MCAT and the complications associated with non-compensatory data, this study aimed to develop MCAT algorithms using non-compensatory MIRT models and to evaluate their performance. For the purpose of the study, three item selection methods were adapted and compared, namely, the Fisher information method, the mutual information method, and the Kullback–Leibler information method. The results of a series of simulations showed that the Fisher information and mutual information methods performed similarly, and both outperformed the Kullback–Leibler information method. In addition, it was found that the more stringent the termination criterion and the higher the correlation between the latent traits, the higher the resulting measurement precision and test reliability. Test reliability was very similar across the dimensions, regardless of the correlation between the latent traits and termination criterion. On average, the difficulties of the administered items were found to be at a lower level than the examinees’ abilities, which shed light on item bank construction for non-compensatory items.1 aHsu, Chia-Ling1 aWang, Wen-Chung uhttps://doi.org/10.1177/014662161880028001267nas a2200157 4500008003900000245009900039210006900138300001200207490000700219520076400226100001800990700001501008700001801023700002301041856004501064 2018 d00aA Continuous a-Stratification Index for Item Exposure Control in Computerized Adaptive Testing0 aContinuous aStratification Index for Item Exposure Control in Co a523-5370 v423 aThe method of a-stratification aims to reduce item overexposure in computerized adaptive testing, as items that are administered at very high rates may threaten the validity of test scores. In existing methods of a-stratification, the item bank is partitioned into a fixed number of nonoverlapping strata according to the items’a, or discrimination, parameters. This article introduces a continuous a-stratification index which incorporates exposure control into the item selection index itself and thus eliminates the need for fixed discrete strata. The new continuous a-stratification index is compared with existing stratification methods via simulation studies in terms of ability estimation bias, mean squared error, and control of item exposure rates.1 aHuebner, Alan1 aWang, Chun1 aDaly, Bridget1 aPinkelman, Colleen uhttps://doi.org/10.1177/014662161875828901674nas a2200157 4500008003900000245014600039210006900185300001200254490000700266520111500273100001801388700001701406700001301423700001701436856006301453 2018 d00aEvaluation of a New Method for Providing Full Review Opportunities in Computerized Adaptive Testing—Computerized Adaptive Testing With Salt0 aEvaluation of a New Method for Providing Full Review Opportuniti a582-5940 v553 aAbstract Allowing item review in computerized adaptive testing (CAT) is getting more attention in the educational measurement field as more and more testing programs adopt CAT. The research literature has shown that allowing item review in an educational test could result in more accurate estimates of examinees’ abilities. The practice of item review in CAT, however, is hindered by the potential danger of test-manipulation strategies. To provide review opportunities to examinees while minimizing the effect of test-manipulation strategies, researchers have proposed different algorithms to implement CAT with restricted revision options. In this article, we propose and evaluate a new method that implements CAT without any restriction on item review. In particular, we evaluate the new method in terms of the accuracy on ability estimates and the robustness against test-manipulation strategies. This study shows that the newly proposed method is promising in a win-win situation: examinees have full freedom to review and change answers, and the impacts of test-manipulation strategies are undermined.1 aCui, Zhongmin1 aLiu, Chunyan1 aHe, Yong1 aChen, Hanwei uhttps://onlinelibrary.wiley.com/doi/abs/10.1111/jedm.1219300515nas a2200133 4500008003900000245012900039210006900168300000900237490000600246100001800252700002700270700002400297856006000321 2018 d00aFactors Affecting the Classification Accuracy and Average Length of a Variable-Length Cognitive Diagnostic Computerized Test0 aFactors Affecting the Classification Accuracy and Average Length a1-140 v61 aHuebner, Alan1 aFinkelman, Matthew, D.1 aWeissman, Alexander uhttp://iacat.org/jcat/index.php/jcat/article/view/55/3001840nas a2200157 4500008003900000245010800039210006900147300001200216490000700228520134100235100001501576700001601591700001301607700001701620856004501637 2018 d00aItem Selection Methods in Multidimensional Computerized Adaptive Testing With Polytomously Scored Items0 aItem Selection Methods in Multidimensional Computerized Adaptive a677-6940 v423 aMultidimensional computerized adaptive testing (MCAT) has been developed over the past decades, and most of them can only deal with dichotomously scored items. However, polytomously scored items have been broadly used in a variety of tests for their advantages of providing more information and testing complicated abilities and skills. The purpose of this study is to discuss the item selection algorithms used in MCAT with polytomously scored items (PMCAT). Several promising item selection algorithms used in MCAT are extended to PMCAT, and two new item selection methods are proposed to improve the existing selection strategies. Two simulation studies are conducted to demonstrate the feasibility of the extended and proposed methods. The simulation results show that most of the extended item selection methods for PMCAT are feasible and the new proposed item selection methods perform well. Combined with the security of the pool, when two dimensions are considered (Study 1), the proposed modified continuous entropy method (MCEM) is the ideal of all in that it gains the lowest item exposure rate and has a relatively high accuracy. As for high dimensions (Study 2), results show that mutual information (MUI) and MCEM keep relatively high estimation accuracy, and the item exposure rates decrease as the correlation increases.1 aTu, Dongbo1 aHan, Yuting1 aCai, Yan1 aGao, Xuliang uhttps://doi.org/10.1177/014662161876274805044nas a2200145 4500008004100000245008900041210006900130260005500199520447200254653000804726653002904734100001804763700001504781856010204796 2017 eng d00aComparison of Pretest Item Calibration Methods in a Computerized Adaptive Test (CAT)0 aComparison of Pretest Item Calibration Methods in a Computerized aNiigata, JapanbNiigata Seiryo Universityc08/20173 a

Calibration methods for pretest items in a computerized adaptive test (CAT) are not a new area of research inquiry. After decades of research on CAT, the fixed item parameter calibration (FIPC) method has been widely accepted and used by practitioners to address two CAT calibration issues: (a) a restricted ability range each item is exposed to, and (b) a sparse response data matrix. In FIPC, the parameters of the operational items are fixed at their original values, and multiple expectation maximization (EM) cycles are used to estimate parameters of the pretest items with prior ability distribution being updated multiple times (Ban, Hanson, Wang, Yi, & Harris, 2001; Kang & Peterson, 2009; Pommerich & Segall, 2003).

Another calibration method is the fixed person parameter calibration (FPPC) method proposed by Stocking (1988) as “Method A.” Under this approach, candidates’ ability estimates are fixed in the calibration of pretest items and they define the scale on which the parameter estimates are reported. The logic of FPPC is suitable for CAT applications because the person parameters are estimated based on operational items and available for pretest item calibration. In Stocking (1988), the FPPC was evaluated using the LOGIST computer program developed by Wood, Wingersky, and Lord (1976). He reported that “Method A” produced larger root mean square errors (RMSEs) in the middle ability range than “Method B,” which required the use of anchor items (administered non-adaptively) and linking steps to attempt to correct for the potential scale drift due to the use of imperfect ability estimates.

Since then, new commercial software tools such as BILOG-MG and flexMIRT (Cai, 2013) have been developed to handle the FPPC method with different implementations (e.g., the MH-RM algorithm with flexMIRT). The performance of the FPPC method with those new software tools, however, has rarely been researched in the literature.

In our study, we evaluated the performance of two pretest item calibration methods using flexMIRT, the new software tool. The FIPC and FPPC are compared under various CAT settings. Each simulated exam contains 75% operational items and 25% pretest items, and real item parameters are used to generate the CAT data. This study also addresses the lack of guidelines in existing CAT item calibration literature regarding population ability shift and exam length (more accurate theta estimates are expected in longer exams). Thus, this study also investigates the following four factors and their impact on parameter estimation accuracy, including: (1) candidate population changes (3 ability distributions); (2) exam length (20: 15 OP + 5 PT, 40: 30 OP + 10 PT, and 60: 45 OP + 15 PT); (3) data model fit (3PL and 3PL with fixed C), and (4) pretest item calibration sample sizes (300, 500, and 1000). This study’s findings will fill the gap in this area of research and thus provide new information on which practitioners can base their decisions when selecting a pretest calibration method for their exams.

References

Ban, J. C., Hanson, B. A., Wang, T., Yi, Q., & Harris, D. J. (2001). A comparative study of online pretest item—Calibration/scaling methods in computerized adaptive testing. Journal of Educational Measurement, 38(3), 191–212.

Cai, L. (2013). flexMIRT® Flexible Multilevel Multidimensional Item Analysis and Test Scoring (Version 2) [Computer software]. Chapel Hill, NC: Vector Psychometric Group.

Kang, T., & Petersen, N. S. (2009). Linking item parameters to a base scale (Research Report No. 2009– 2). Iowa City, IA: ACT.

Pommerich, M., & Segall, D.O. (2003, April). Calibrating CAT pools and online pretest items using marginal maximum likelihood methods. Paper presented at the annual meeting of the National Council on Measurement in Education, Chicago, IL.

Stocking, M. L. (1988). Scale drift in online calibration (Research Report No. 88–28). Princeton, NJ: Educational Testing Service.

Wood, R. L., Wingersky, M. S., & Lord, F. M. (1976). LOGIST: A computer program for estimating examinee ability and item characteristic curve parameters (RM76-6) [Computer program]. Princeton, NJ: Educational Testing Service.

Session Video

10aCAT10aPretest Item Calibration1 aMeng, Huijuan1 aHan, Chris uhttp://www.iacat.org/comparison-pretest-item-calibration-methods-computerized-adaptive-test-cat-003452nas a2200157 4500008004100000245008400041210006900125260005500194520283600249653001203085653002503097653002803122100002303150700002003173856010103193 2017 eng d00aConsiderations in Performance Evaluations of Computerized Formative Assessments0 aConsiderations in Performance Evaluations of Computerized Format aNiigata, JapanbNiigata Seiryo Universityc08/20173 a

Computerized adaptive instruments have been widely established and used in the context of summative assessments for purposes including licensure, admissions and proficiency testing. The benefits of examinee tailored examinations, which can provide estimates of performance that are more reliable and valid, have in recent years attracted a greater audience (i.e. patient oriented outcomes, test prep, etc.). Formative assessment, which are most widely understood in their implementation as diagnostic tools, have recently started to expand to lesser known areas of computerized testing such as in implementations of instructional designs aiming to maximize examinee learning through targeted practice.

Using a CAT instrument within the framework of evaluating repetitious examinee performances (in such settings as a Quiz Bank practices for example) poses unique challenges not germane to summative assessments. The scale on which item parameters (and subsequently examinee performance estimates such as Maximum Likelihood Estimates) are determined usually do not take change over time under consideration. While vertical scaling features resolve the learning acquisition problem, most content practice engines do not make use of explicit practice windows which could be vertically aligned. Alternatively, the Multidimensional (MIRT)- and Hierarchical Item Response Theory (HIRT) models allow for the specification of random effects associated with change over time in examinees’ skills, but are often complex and require content and usage resources not often observed.

The research submitted for consideration simulated examinees’ repeated variable length Quiz Bank practice in algebra using a 500 1-PL operational item pool. The stability simulations sought to determine with which rolling item interval size ability estimates would provide the most informative insight into the examinees’ learning progression over time. Estimates were evaluated in terms of reduction in estimate uncertainty, bias and RMSD with the true and total item based ability estimates. It was found that rolling item intervals between 20-25 items provided the best reduction of uncertainty around the estimate without compromising the ability to provide informed performance estimates to students. However, while asymptotically intervals of 20-25 items tended to provide adequate estimates of performance, changes over shorter periods of time assessed with shorter quizzes could not be detected as those changes would be suppressed in lieu of the performance based on the full interval considered. Implications for infrastructure (such as recommendation engines, etc.), product and scale development are discussed.

Session video

10aalgebra10aFormative Assessment10aPerformance Evaluations1 aChajewski, Michael1 aHarnisher, John uhttp://www.iacat.org/considerations-performance-evaluations-computerized-formative-assessments-001568nas a2200181 4500008003900000245011800039210006900157300001100226490000700237520097700244100001801221700001701239700002501256700001801281700002201299700002001321856004501341 2017 d00aDevelopment of a Computer Adaptive Test for Depression Based on the Dutch-Flemish Version of the PROMIS Item Bank0 aDevelopment of a Computer Adaptive Test for Depression Based on  a79-1050 v403 aWe developed a Dutch-Flemish version of the patient-reported outcomes measurement information system (PROMIS) adult V1.0 item bank for depression as input for computerized adaptive testing (CAT). As item bank, we used the Dutch-Flemish translation of the original PROMIS item bank (28 items) and additionally translated 28 U.S. depression items that failed to make the final U.S. item bank. Through psychometric analysis of a combined clinical and general population sample (N = 2,010), 8 added items were removed. With the final item bank, we performed several CAT simulations to assess the efficiency of the extended (48 items) and the original item bank (28 items), using various stopping rules. Both item banks resulted in highly efficient and precise measurement of depression and showed high similarity between the CAT simulation scores and the full item bank scores. We discuss the implications of using each item bank and stopping rule for further CAT development.1 aFlens, Gerard1 aSmits, Niels1 aTerwee, Caroline, B.1 aDekker, Joost1 aHuijbrechts, Irma1 ade Beurs, Edwin uhttps://doi.org/10.1177/016327871668416806631nas a2200157 4500008004100000245011400041210006900155260005500224520601700279653001106296653004106307653001906348100001706367700001806384856007106402 2017 eng d00aEfficiency of Item Selection in CD-CAT Based on Conjunctive Bayesian Network Modeling Hierarchical attributes0 aEfficiency of Item Selection in CDCAT Based on Conjunctive Bayes aNiigata, JapanbNiigata Seiryo Universityc08/20173 a

Cognitive diagnosis models (CDM) aim to diagnosis examinee’s mastery status of multiple fine-grained skills. As new development for cognitive diagnosis methods emerges, much attention is given to cognitive diagnostic computerized adaptive testing (CD-CAT) as well. The topics such as item selection methods, item exposure control strategies, and online calibration methods, which have been wellstudied for traditional item response theory (IRT) based CAT, are also investigated in the context of CD-CAT (e.g., Xu, Chang, & Douglas, 2003; Wang, Chang, & Huebner, 2011; Chen et al., 2012).

In CDM framework, some researchers suggest to model structural relationship between cognitive skills, or namely, attributes. Especially, attributes can be hierarchical, such that some attributes must be acquired before the subsequent ones are mastered. For example, in mathematics, addition must be mastered before multiplication, which gives a hierarchy model for addition skill and multiplication skill. Recently, new CDMs considering attribute hierarchies have been suggested including the Attribute Hierarchy Method (AHM; Leighton, Gierl, & Hunka, 2004) and the Hierarchical Diagnostic Classification Models (HDCM; Templin & Bradshaw, 2014).

Bayesian Networks (BN), the probabilistic graphical models representing the relationship of a set of random variables using a directed acyclic graph with conditional probability distributions, also provide an efficient framework for modeling the relationship between attributes (Culbertson, 2016). Among various BNs, conjunctive Bayesian network (CBN; Beerenwinkel, Eriksson, & Sturmfels, 2007) is a special kind of BN, which assumes partial ordering between occurrences of events and conjunctive constraints between them.

In this study, we propose using CBN for modeling attribute hierarchies and discuss the advantage of CBN for CDM. We then explore the impact of the CBN modeling on the efficiency of item selection methods for CD-CAT when the attributes are truly hierarchical. To this end, two simulation studies, one for fixed-length CAT and another for variable-length CAT, are conducted. For each studies, two attribute hierarchy structures with 5 and 8 attributes are assumed. Among the various item selection methods developed for CD-CAT, six algorithms are considered: posterior-weighted Kullback-Leibler index (PWKL; Cheng, 2009), the modified PWKL index (MPWKL; Kaplan, de la Torre, Barrada, 2015), Shannon entropy (SHE; Tatsuoka, 2002), mutual information (MI; Wang, 2013), posterior-weighted CDM discrimination index (PWCDI; Zheng & Chang, 2016) and posterior-weighted attribute-level CDM discrimination index (PWACDI; Zheng & Chang, 2016). The impact of Q-matrix structure, item quality, and test termination rules on the efficiency of item selection algorithms is also investigated. Evaluation measures include the attribute classification accuracy (fixed-length experiment) and test length of CDCAT until stopping (variable-length experiment).

The results of the study indicate that the efficiency of item selection is improved by directly modeling the attribute hierarchies using CBN. The test length until achieving diagnosis probability threshold was reduced to 50-70% for CBN based CAT compared to the CD-CAT assuming independence of attributes. The magnitude of improvement is greater when the cognitive model of the test includes more attributes and when the test length is shorter. We conclude by discussing how Q-matrix structure, item quality, and test termination rules affect the efficiency.

References

Beerenwinkel, N., Eriksson, N., & Sturmfels, B. (2007). Conjunctive bayesian networks. Bernoulli, 893- 909.

Chen, P., Xin, T., Wang, C., & Chang, H. H. (2012). Online calibration methods for the DINA model with independent attributes in CD-CAT. Psychometrika, 77(2), 201-222.

Cheng, Y. (2009). When cognitive diagnosis meets computerized adaptive testing: CD-CAT. Psychometrika, 74(4), 619-632.

Culbertson, M. J. (2016). Bayesian networks in educational assessment: the state of the field. Applied Psychological Measurement, 40(1), 3-21.

Kaplan, M., de la Torre, J., & Barrada, J. R. (2015). New item selection methods for cognitive diagnosis computerized adaptive testing. Applied Psychological Measurement, 39(3), 167-188.

Leighton, J. P., Gierl, M. J., & Hunka, S. M. (2004). The attribute hierarchy method for cognitive assessment: a variation on Tatsuoka's rule‐space approach. Journal of Educational Measurement, 41(3), 205-237.

Tatsuoka, C. (2002). Data analytic methods for latent partially ordered classification models. Journal of the Royal Statistical Society: Series C (Applied Statistics), 51(3), 337-350.

Templin, J., & Bradshaw, L. (2014). Hierarchical diagnostic classification models: A family of models for estimating and testing attribute hierarchies. Psychometrika, 79(2), 317-339. Wang, C. (2013). Mutual information item selection method in cognitive diagnostic computerized adaptive testing with short test length. Educational and Psychological Measurement, 73(6), 1017-1035.

Wang, C., Chang, H. H., & Huebner, A. (2011). Restrictive stochastic item selection methods in cognitive diagnostic computerized adaptive testing. Journal of Educational Measurement, 48(3), 255-273.

Xu, X., Chang, H., & Douglas, J. (2003, April). A simulation study to compare CAT strategies for cognitive diagnosis. Paper presented at the annual meeting of National Council on Measurement in Education, Chicago.

Zheng, C., & Chang, H. H. (2016). High-efficiency response distribution–based item selection algorithms for short-length cognitive diagnostic computerized adaptive testing. Applied Psychological Measurement, 40(8), 608-624.

Session Video

10aCD-CAT10aConjuctive Bayesian Network Modeling10aitem selection1 aHan, Soo-Yun1 aYoo, Yun, Joo uhttps://drive.google.com/open?id=1RbO2gd4aULqsSgRi_VZudNN_edX82NeD03610nas a2200169 4500008004100000245006900041210006600110260005500176520302300231653000803254653002403262653003303286100001503319700001803334700001703352856007103369 2017 eng d00aAn Imputation Approach to Handling Incomplete Computerized Tests0 aImputation Approach to Handling Incomplete Computerized Tests aNiigata, JapanbNiigata Seiryo Universityc08/20173 a

As technology advances, computerized adaptive testing (CAT) is becoming increasingly popular as it allows tests to be tailored to an examinee’s ability.  Nevertheless, examinees might devise testing strategies to use CAT to their advantage.  For instance, if only the items that examinees answer count towards their score, then a higher theta score might be obtained by spending more time on items at the beginning of the test and skipping items at the end if time runs out. This type of gaming can be discouraged if examinees’ scores are lowered or “penalized” based on the amount of non-response.

The goal of this study was to devise a penalty function that would meet two criteria: 1) the greater the omit rate, the greater the penalty, and 2) examinees with the same ability and the same omit rate should receive the same penalty. To create the penalty, theta was calculated based on only the items the examinee responded to ( ).  Next, the expected number correct score (EXR) was obtained using  and the test characteristic curve. A penalized expected number correct score (E ) was obtained by multiplying EXR by the proportion of items the examinee responded to. Finally, the penalized theta ( ) was identified using the test characteristic curve. Based on   and the item parameters ( ) of an unanswered item, the likelihood of a correct response,  , is computed and employed to estimate the imputed score ( ) for the unanswered item.

Two datasets were used to generate tests with completion rates of 50%, 80%, and 90%.  The first dataset included real data where approximately 4,500 examinees responded to a 21 -item test which provided a baseline/truth. Sampling was done to achieve the three completion rate conditions. The second dataset consisted of simulated item scores for 50,000 simulees under a 1-2-4 multi-stage CAT design where each stage contained seven items. Imputed item scores for unanswered items were computed using a variety of values for G (and therefore T).  Three other approaches to handling unanswered items were also considered: all correct (i.e., T = 0), all incorrect (i.e., T = 1), and random scoring (i.e., T = 0.5).

The current study investigated the impact on theta estimates resulting from the proposed approach to handling unanswered items in a fixed-length CAT. In real testing situations, when examinees do not finish a test, it is hard to tell whether they tried diligently but ran out of time or whether they attempted to manipulate the scoring engine.  To handle unfinished tests with penalties, the proposed approach considers examinees’ abilities and incompletion rates. The results of this study provide direction for psychometric practitioners when considering penalties for omitted responses.

Session Video

10aCAT10aimputation approach10aincomplete computerized test1 aChen, Troy1 aHuang, Chi-Yu1 aLiu, Chunyan uhttps://drive.google.com/open?id=1vznZeO3nsZZK0k6_oyw5c9ZTP8uyGnXh01106nas a2200169 4500008003900000020001400039245010200053210006900155260001500224300001400239490000700253520057900260100001900839700001600858700001700874856004500891 2017 d a0146-621600aThe Information Product Methods: A Unified Approach to Dual-Purpose Computerized Adaptive Testing0 aInformation Product Methods A Unified Approach to DualPurpose Co c2018/06/01 a321 - 3240 v423 aThis article gives a brief summary of major approaches in dual-purpose computerized adaptive testing (CAT) in which the test is tailored interactively to both an examinee?s overall ability level, ?, and attribute mastery level, α. It also proposes an information product approach whose connections to the current methods are revealed. An updated comprehensive empirical study demonstrated that the information product approach not only can offer a unified framework to connect all other approaches but also can mitigate the weighting issue in the dual-information approach.1 aZheng, Chanjin1 aHe, Guanrui1 aGao, Chunlei uhttps://doi.org/10.1177/014662161773039201393nas a2200169 4500008004100000245003600041210003600077260005500113520088800168653000801056653002101064100002101085700001201106700001601118700001801134856007101152 2017 eng d00aItem Pool Design and Evaluation0 aItem Pool Design and Evaluation aNiigata, JapanbNiigata Seiryo Universityc08/20173 a

Early work on CAT tended to use existing sets of items which came from fixed length test forms. These sets of items were selected to meet much different requirements than are needed for a CAT; decision making or covering a content domain. However, there was also some early work that suggested having items equally distributed over the range of proficiency that was of interest or concentrated at a decision point. There was also some work that showed that there was bias in proficiency estimates when an item pool was too easy or too hard. These early findings eventually led to work on item pool design and, more recently, on item pool evaluation. This presentation gives a brief overview of these topics to give some context for the following presentations in this symposium.

Session Video

10aCAT10aItem Pool Design1 aReckase, Mark, D1 aHe, Wei1 aXu, Jing-Ru1 aZhou, Xuechun uhttps://drive.google.com/open?id=1ZAsqm1yNZlliqxEHcyyqQ_vOSu20xxZs02365nas a2200277 4500008004100000245007100041210006900112260005500181520152900236653000801765653001501773653002801788100001501816700002101831700001501852700001401867700001601881700001501897700001601912700001601928700001601944700001801960700001901978700001901997856007102016 2017 eng d00aNew Challenges (With Solutions) and Innovative Applications of CAT0 aNew Challenges With Solutions and Innovative Applications of CAT aNiigata, JapanbNiigata Seiryo Universityc08/20173 a

Over the past several decades, computerized adaptive testing (CAT) has profoundly changed the administration of large-scale aptitude tests, state-wide achievement tests, professional licensure exams, and health outcome measures. While many challenges of CAT have been successfully addressed due to the continual efforts of researchers in the field, there are still many remaining, longstanding challenges that have yet to be resolved. This symposium will begin with three presentations, each of which provides a sound solution to one of the unresolved challenges. They are (1) item calibration when responses are “missing not at random” from CAT administration; (2) online calibration of new items when person traits have non-ignorable measurement error; (3) establishing consistency and asymptotic normality of latent trait estimation when allowing item response revision in CAT. In addition, this symposium also features innovative applications of CAT. In particular, there is emerging interest in using cognitive diagnostic CAT to monitor and detect learning progress (4th presentation). Last but not least, the 5th presentation illustrates the power of multidimensional polytomous CAT that permits rapid identification of hospitalized patients’ rehabilitative care needs in health outcomes measurement. We believe this symposium covers a wide range of interesting and important topics in CAT.

Session Video

10aCAT10achallenges10ainnovative applications1 aWang, Chun1 aWeiss, David, J.1 aZhang, Xue1 aTao, Jian1 aHe, Yinhong1 aChen, Ping1 aWang, Shiyu1 aZhang, Susu1 aLin, Haiyan1 aGao, Xiaohong1 aChang, Hua-Hua1 aShang, Zhuoran uhttps://drive.google.com/open?id=1Wvgxw7in_QCq_F7kzID6zCZuVXWcFDPa02152nas a2200157 4500008004100000245008800041210006900129260005400198520153900252653002901791653001101820100001901831700002001850700001801870856010601888 2017 eng d00aUsing Bayesian Decision Theory in Cognitive Diagnosis Computerized Adaptive Testing0 aUsing Bayesian Decision Theory in Cognitive Diagnosis Computeriz aNiigata JapanbNiigata Seiryo Universityc08/20173 a

Cognitive diagnosis computerized adaptive testing (CD-CAT) purports to provide each individual a profile about the strengths and weaknesses of attributes or skills with computerized adaptive testing. In the CD-CAT literature, researchers dedicated to evolving item selection algorithms to improve measurement efficiency, and most algorithms were developed based on information theory. By the discontinuous nature of the latent variables in CD-CAT, this study introduced an alternative for item selection, called the minimum expected cost (MEC) method, which was derived based on Bayesian decision theory. Using simulations, the MEC method was evaluated against the posterior weighted Kullback-Leibler (PWKL) information, the modified PWKL (MPWKL), and the mutual information (MI) methods by manipulating item bank quality, item selection algorithm, and termination rule. Results indicated that, regardless of item quality and termination criterion, the MEC, MPWKL, and MI methods performed very similarly and they all outperformed the PWKL method in classification accuracy and test efficiency, especially in short tests; the MEC method had more efficient item bank usage than the MPWKL and MI methods. Moreover, the MEC method could consider the costs of incorrect decisions and improve classification accuracy and test efficiency when a particular profile was of concern. All the results suggest the practicability of the MEC method in CD-CAT.

Session Video

10aBayesian Decision Theory10aCD-CAT1 aHsu, Chia-Ling1 aWang, Wen-Chung1 aChen, ShuYing uhttp://www.iacat.org/using-bayesian-decision-theory-cognitive-diagnosis-computerized-adaptive-testing01809nas a2200133 4500008003900000245010300039210006900142300001200211490000700223520134300230100002201573700002701595856005301622 2016 d00aOn Computing the Key Probability in the Stochastically Curtailed Sequential Probability Ratio Test0 aComputing the Key Probability in the Stochastically Curtailed Se a142-1560 v403 aThe Stochastically Curtailed Sequential Probability Ratio Test (SCSPRT) is a termination criterion for computerized classification tests (CCTs) that has been shown to be more efficient than the well-known Sequential Probability Ratio Test (SPRT). The performance of the SCSPRT depends on computing the probability that at a given stage in the test, an examinee’s current interim classification status will not change before the end of the test. Previous work discusses two methods of computing this probability, an exact method in which all potential responses to remaining items are considered and an approximation based on the central limit theorem (CLT) requiring less computation. Generally, the CLT method should be used early in the test when the number of remaining items is large, and the exact method is more appropriate at later stages of the test when few items remain. However, there is currently a dearth of information as to the performance of the SCSPRT when using the two methods. For the first time, the exact and CLT methods of computing the crucial probability are compared in a simulation study to explore whether there is any effect on the accuracy or efficiency of the CCT. The article is focused toward practitioners and researchers interested in using the SCSPRT as a termination criterion in an operational CCT.1 aHuebner, Alan, R.1 aFinkelman, Matthew, D. uhttp://apm.sagepub.com/content/40/2/142.abstract01950nas a2200121 4500008003900000245011400039210006900153300001200222490000700234520151600241100001801757856005301775 2016 d00aMaximum Likelihood Score Estimation Method With Fences for Short-Length Tests and Computerized Adaptive Tests0 aMaximum Likelihood Score Estimation Method With Fences for Short a289-3010 v403 aA critical shortcoming of the maximum likelihood estimation (MLE) method for test score estimation is that it does not work with certain response patterns, including ones consisting only of all 0s or all 1s. This can be problematic in the early stages of computerized adaptive testing (CAT) administration and for tests short in length. To overcome this challenge, test practitioners often set lower and upper bounds of theta estimation and truncate the score estimation to be one of those bounds when the log likelihood function fails to yield a peak due to responses consisting only of 0s or 1s. Even so, this MLE with truncation (MLET) method still cannot handle response patterns in which all harder items are correct and all easy items are incorrect. Bayesian-based estimation methods such as the modal a posteriori (MAP) method or the expected a posteriori (EAP) method can be viable alternatives to MLE. The MAP or EAP methods, however, are known to result in estimates biased toward the center of a prior distribution, resulting in a shrunken score scale. This study introduces an alternative approach to MLE, called MLE with fences (MLEF). In MLEF, several imaginary “fence” items with fixed responses are introduced to form a workable log likelihood function even with abnormal response patterns. The findings of this study suggest that, unlike MLET, the MLEF can handle any response patterns and, unlike both MAP and EAP, results in score estimates that do not cause shrinkage of the theta scale.1 aHan, Kyung, T uhttp://apm.sagepub.com/content/40/4/289.abstract01699nas a2200145 4500008003900000245009300039210006900132490000700201520118000208100001301388700001901401700001501420700001101435856010701446 2016 d00aUsing Response Time to Detect Item Preknowledge in Computer?Based Licensure Examinations0 aUsing Response Time to Detect Item Preknowledge in ComputerBased0 v353 aThis article addresses the issue of how to detect item preknowledge using item response time data in two computer-based large-scale licensure examinations. Item preknowledge is indicated by an unexpected short response time and a correct response. Two samples were used for detecting item preknowledge for each examination. The first sample was from the early stage of the operational test and was used for item calibration. The second sample was from the late stage of the operational test, which may feature item preknowledge. The purpose of this research was to explore whether there was evidence of item preknowledge and compromised items in the second sample using the parameters estimated from the first sample. The results showed that for one nonadaptive operational examination, two items (of 111) were potentially exposed, and two candidates (of 1,172) showed some indications of preknowledge on multiple items. For another licensure examination that featured computerized adaptive testing, there was no indication of item preknowledge or compromised items. Implications for detected aberrant examinees and compromised items are discussed in the article.1 aH., Qian1 aStaniewska, D.1 aReckase, M1 aWoo, A uhttp://www.iacat.org/using-response-time-detect-item-preknowledge-computerbased-licensure-examinations01714nas a2200145 4500008003900000022001400039245008400053210006900137300001400206490000700220520126100227100001901488700002001507856004101527 2015 d a1745-398400aVariable-Length Computerized Adaptive Testing Using the Higher Order DINA Model0 aVariableLength Computerized Adaptive Testing Using the Higher Or a125–1430 v523 aCognitive diagnosis models provide profile information about a set of latent binary attributes, whereas item response models yield a summary report on a latent continuous trait. To utilize the advantages of both models, higher order cognitive diagnosis models were developed in which information about both latent binary attributes and latent continuous traits is available. To facilitate the utility of cognitive diagnosis models, corresponding computerized adaptive testing (CAT) algorithms were developed. Most of them adopt the fixed-length rule to terminate CAT and are limited to ordinary cognitive diagnosis models. In this study, the higher order deterministic-input, noisy-and-gate (DINA) model was used as an example, and three criteria based on the minimum-precision termination rule were implemented: one for the latent class, one for the latent trait, and the other for both. The simulation results demonstrated that all of the termination criteria were successful when items were selected according to the Kullback-Leibler information and the posterior-weighted Kullback-Leibler information, and the minimum-precision rule outperformed the fixed-length rule with a similar test length in recovering the latent attributes and the latent trait.1 aHsu, Chia-Ling1 aWang, Wen-Chung uhttp://dx.doi.org/10.1111/jedm.1206901689nas a2200145 4500008003900000245007800039210006900117300001200186490000700198520124300205100001201448700001301460700001701473856005301490 2014 d00aA Comparison of Four Item-Selection Methods for Severely Constrained CATs0 aComparison of Four ItemSelection Methods for Severely Constraine a677-6960 v743 a

This study compared four item-selection procedures developed for use with severely constrained computerized adaptive tests (CATs). Severely constrained CATs refer to those adaptive tests that seek to meet a complex set of constraints that are often not conclusive to each other (i.e., an item may contribute to the satisfaction of several constraints at the same time). The procedures examined in the study included the weighted deviation model (WDM), the weighted penalty model (WPM), the maximum priority index (MPI), and the shadow test approach (STA). In addition, two modified versions of the MPI procedure were introduced to deal with an edge case condition that results in the item selection procedure becoming dysfunctional during a test. The results suggest that the STA worked best among all candidate methods in terms of measurement accuracy and constraint management. For the other three heuristic approaches, they did not differ significantly in measurement accuracy and constraint management at the lower bound level. However, the WPM method appears to perform considerably better in overall constraint management than either the WDM or MPI method. Limitations and future research directions were also discussed.

1 aHe, Wei1 aDiao, Qi1 aHauser, Carl uhttp://epm.sagepub.com/content/74/4/677.abstract01730nas a2200133 4500008003900000245008300039210006900122300001200191490000700203520130000210100001201510700002101522856005301543 2014 d00aItem Pool Design for an Operational Variable-Length Computerized Adaptive Test0 aItem Pool Design for an Operational VariableLength Computerized  a473-4940 v743 a

For computerized adaptive tests (CATs) to work well, they must have an item pool with sufficient numbers of good quality items. Many researchers have pointed out that, in developing item pools for CATs, not only is the item pool size important but also the distribution of item parameters and practical considerations such as content distribution and item exposure issues. Yet, there is little research on how to design item pools to have those desirable features. The research reported in this article provided step-by-step hands-on guidance on the item pool design process by applying the bin-and-union method to design item pools for a large-scale licensure CAT employing complex adaptive testing algorithm with variable test length, a decision based on stopping rule, content balancing, and exposure control. The design process involved extensive simulations to identify several alternative item pool designs and evaluate their performance against a series of criteria. The design output included the desired item pool size and item parameter distribution. The results indicate that the mechanism used to identify the desirable item pool features functions well and that two recommended item pool designs would support satisfactory performance of the operational testing program.

1 aHe, Wei1 aReckase, Mark, D uhttp://epm.sagepub.com/content/74/3/473.abstract01676nas a2200145 4500008003900000245012600039210006900165300001200234490000700246520115400253100002601407700002201433700002201455856005301477 2014 d00aStratified Item Selection and Exposure Control in Unidimensional Adaptive Testing in the Presence of Two-Dimensional Data0 aStratified Item Selection and Exposure Control in Unidimensional a563-5760 v383 a

It is not uncommon to use unidimensional item response theory models to estimate ability in multidimensional data with computerized adaptive testing (CAT). The current Monte Carlo study investigated the penalty of this model misspecification in CAT implementations using different item selection methods and exposure control strategies. Three item selection methods—maximum information (MAXI), a-stratification (STRA), and a-stratification with b-blocking (STRB) with and without Sympson–Hetter (SH) exposure control strategy—were investigated. Calibrating multidimensional items as unidimensional items resulted in inaccurate item parameter estimates. Therefore, MAXI performed better than STRA and STRB in estimating the ability parameters. However, all three methods had relatively large standard errors. SH exposure control had no impact on the number of overexposed items. Existing unidimensional CAT implementations might consider using MAXI only if recalibration as multidimensional model is too expensive. Otherwise, building a CAT pool by calibrating multidimensional data as unidimensional is not recommended.

1 aKalinowski, Kevin, E.1 aNatesan, Prathiba1 aHenson, Robin, K. uhttp://apm.sagepub.com/content/38/7/563.abstract01640nas a2200157 4500008003900000245007600039210006900115300001200184490000700196520114800203100002301351700001801374700001601392700002101408856005301429 2013 d00aA Comparison of Exposure Control Procedures in CATs Using the 3PL Model0 aComparison of Exposure Control Procedures in CATs Using the 3PL  a857-8740 v733 a

This study compares the progressive-restricted standard error (PR-SE) exposure control procedure to three commonly used procedures in computerized adaptive testing, the randomesque, Sympson–Hetter (SH), and no exposure control methods. The performance of these four procedures is evaluated using the three-parameter logistic model under the manipulated conditions of item pool size (small vs. large) and stopping rules (fixed-length vs. variable-length). PR-SE provides the advantage of similar constraints to SH, without the need for a preceding simulation study to execute it. Overall for the large and small item banks, the PR-SE method administered almost all of the items from the item pool, whereas the other procedures administered about 52% or less of the large item bank and 80% or less of the small item bank. The PR-SE yielded the smallest amount of item overlap between tests across conditions and administered fewer items on average than SH. PR-SE obtained these results with similar, and acceptable, measurement precision compared to the other exposure control procedures while vastly improving on item pool usage.

1 aLeroux, Audrey, J.1 aLopez, Myriam1 aHembry, Ian1 aDodd, Barbara, G uhttp://epm.sagepub.com/content/73/5/857.abstract00533nas a2200145 4500008004100000245009500041210006900136300001000205490000600215100001900221700001100240700001000251700001300261856011300274 2013 en d00aItem Ordering in Stochastically Curtailed Health Questionnaires With an Observable Outcome0 aItem Ordering in Stochastically Curtailed Health Questionnaires  a38-660 v11 aFinkelman, M D1 aKim, W1 aHe, Y1 aLai, A M uhttp://www.iacat.org/content/item-ordering-stochastically-curtailed-health-questionnaires-observable-outcome01492nas a2200121 4500008003900000245009200039210006900131300001200200490000700212520108000219100001801299856005301317 2013 d00aItem Pocket Method to Allow Response Review and Change in Computerized Adaptive Testing0 aItem Pocket Method to Allow Response Review and Change in Comput a259-2750 v373 a

Most computerized adaptive testing (CAT) programs do not allow test takers to review and change their responses because it could seriously deteriorate the efficiency of measurement and make tests vulnerable to manipulative test-taking strategies. Several modified testing methods have been developed that provide restricted review options while limiting the trade-off in CAT efficiency. The extent to which these methods provided test takers with options to review test items, however, still was quite limited. This study proposes the item pocket (IP) method, a new testing approach that allows test takers greater flexibility in changing their responses by eliminating restrictions that prevent them from moving across test sections to review their answers. A series of simulations were conducted to evaluate the robustness of the IP method against various manipulative test-taking strategies. Findings and implications of the study suggest that the IP method may be an effective solution for many CAT programs when the IP size and test time limit are properly set.

1 aHan, Kyung, T uhttp://apm.sagepub.com/content/37/4/259.abstract01716nas a2200145 4500008003900000245008600039210006900125300001200194490000700206520124600213100001901459700002001478700001901498856005301517 2013 d00aVariable-Length Computerized Adaptive Testing Based on Cognitive Diagnosis Models0 aVariableLength Computerized Adaptive Testing Based on Cognitive  a563-5820 v373 a

Interest in developing computerized adaptive testing (CAT) under cognitive diagnosis models (CDMs) has increased recently. CAT algorithms that use a fixed-length termination rule frequently lead to different degrees of measurement precision for different examinees. Fixed precision, in which the examinees receive the same degree of measurement precision, is a major advantage of CAT over nonadaptive testing. In addition to the precision issue, test security is another important issue in practical CAT programs. In this study, the authors implemented two termination criteria for the fixed-precision rule and evaluated their performance under two popular CDMs using simulations. The results showed that using the two criteria with the posterior-weighted Kullback–Leibler information procedure for selecting items could achieve the prespecified measurement precision. A control procedure was developed to control item exposure and test overlap simultaneously among examinees. The simulation results indicated that in contrast to no method of controlling exposure, the control procedure developed in this study could maintain item exposure and test overlap at the prespecified level at the expense of only a few more items.

1 aHsu, Chia-Ling1 aWang, Wen-Chung1 aChen, Shu-Ying uhttp://apm.sagepub.com/content/37/7/563.abstract01847nas a2200169 4500008004100000245012200041210006900163300001200232490000700244520124800251100001201499700001101511700001401522700001101536700001401547856011601561 2012 eng d00aComparison Between Dichotomous and Polytomous Scoring of Innovative Items in a Large-Scale Computerized Adaptive Test0 aComparison Between Dichotomous and Polytomous Scoring of Innovat a493-5090 v723 a

This study explored the impact of partial credit scoring of one type of innovative items (multiple-response items) in a computerized adaptive version of a large-scale licensure pretest and operational test settings. The impacts of partial credit scoring on the estimation of the ability parameters and classification decisions in operational test settings were explored in one real data analysis and two simulation studies when two different polytomous scoring algorithms, automated polytomous scoring and rater-generated polytomous scoring, were applied. For the real data analyses, the ability estimates from dichotomous and polytomous scoring were highly correlated; the classification consistency between different scoring algorithms was nearly perfect. Information distribution changed slightly in the operational item bank. In the two simulation studies comparing each polytomous scoring with dichotomous scoring, the ability estimates resulting from polytomous scoring had slightly higher measurement precision than those resulting from dichotomous scoring. The practical impact related to classification decision was minor because of the extremely small number of items that could be scored polytomously in this current study.

1 aJiao, H1 aLiu, J1 aHaynie, K1 aWoo, A1 aGorham, J uhttp://www.iacat.org/content/comparison-between-dichotomous-and-polytomous-scoring-innovative-items-large-scale01240nas a2200145 4500008003900000245009000039210006900129300001200198490000700210520076800217100001900985700001701004700002001021856005301041 2012 d00aComputerized Adaptive Testing Using a Class of High-Order Item Response Theory Models0 aComputerized Adaptive Testing Using a Class of HighOrder Item Re a689-7060 v363 a

In the human sciences, a common assumption is that latent traits have a hierarchical structure. Higher order item response theory models have been developed to account for this hierarchy. In this study, computerized adaptive testing (CAT) algorithms based on these kinds of models were implemented, and their performance under a variety of situations was examined using simulations. The results showed that the CAT algorithms were very effective. The progressive method for item selection, the Sympson and Hetter method with online and freeze procedure for item exposure control, and the multinomial model for content balancing can simultaneously maintain good measurement precision, item exposure control, content balance, test security, and pool usage.

1 aHuang, Hung-Yu1 aChen, Po-Hsi1 aWang, Wen-Chung uhttp://apm.sagepub.com/content/36/8/689.abstract01496nas a2200157 4500008003900000022001400039245006400053210006400117300001400181490000700195520101300202100002401215700002001239700002401259856005501283 2012 d a1745-398400aDetecting Local Item Dependence in Polytomous Adaptive Data0 aDetecting Local Item Dependence in Polytomous Adaptive Data a127–1470 v493 a

A rapidly expanding arena for item response theory (IRT) is in attitudinal and health-outcomes survey applications, often with polytomous items. In particular, there is interest in computer adaptive testing (CAT). Meeting model assumptions is necessary to realize the benefits of IRT in this setting, however. Although initial investigations of local item dependence have been studied both for polytomous items in fixed-form settings and for dichotomous items in CAT settings, there have been no publications applying local item dependence detection methodology to polytomous items in CAT despite its central importance to these applications. The current research uses a simulation study to investigate the extension of widely used pairwise statistics, Yen's Q3 Statistic and Pearson's Statistic X2, in this context. The simulation design and results are contextualized throughout with a real item bank of this type from the Patient-Reported Outcomes Measurement Information System (PROMIS).

1 aMislevy, Jessica, L1 aRupp, André, A1 aHarring, Jeffrey, R uhttp://dx.doi.org/10.1111/j.1745-3984.2012.00165.x01355nas a2200133 4500008003900000022001400039245010100053210006900154300001400223490000700237520090400244100001801148856005501166 2012 d a1745-398400aAn Efficiency Balanced Information Criterion for Item Selection in Computerized Adaptive Testing0 aEfficiency Balanced Information Criterion for Item Selection in  a225–2460 v493 a

Successful administration of computerized adaptive testing (CAT) programs in educational settings requires that test security and item exposure control issues be taken seriously. Developing an item selection algorithm that strikes the right balance between test precision and level of item pool utilization is the key to successful implementation and long-term quality control of CAT. This study proposed a new item selection method using the “efficiency balanced information” criterion to address issues with the maximum Fisher information method and stratification methods. According to the simulation results, the new efficiency balanced information method had desirable advantages over the other studied item selection methods in terms of improving the optimality of CAT assembly and utilizing items with low a-values while eliminating the need for item pool stratification.

1 aHan, Kyung, T uhttp://dx.doi.org/10.1111/j.1745-3984.2012.00173.x01556nas a2200169 4500008003900000245012400039210006900163300001000232490000700242520099400249100001901243700001801262700001801280700001601298700002001314856005201334 2012 d00aAn Empirical Evaluation of the Slip Correction in the Four Parameter Logistic Models With Computerized Adaptive Testing0 aEmpirical Evaluation of the Slip Correction in the Four Paramete a75-870 v363 a

In a selected response test, aberrant responses such as careless errors and lucky guesses might cause error in ability estimation because these responses do not actually reflect the knowledge that examinees possess. In a computerized adaptive test (CAT), these aberrant responses could further cause serious estimation error due to dynamic item administration. To enhance the robust performance of CAT against aberrant responses, Barton and Lord proposed the four-parameter logistic (4PL) item response theory (IRT) model. However, most studies relevant to the 4PL IRT model were conducted based on simulation experiments. This study attempts to investigate the performance of the 4PL IRT model as a slip-correction mechanism with an empirical experiment. The results showed that the 4PL IRT model could not only reduce the problematic underestimation of the examinees’ ability introduced by careless mistakes in practical situations but also improve measurement efficiency.

1 aYen, Yung-Chin1 aHo, Rong-Guey1 aLaio, Wen-Wei1 aChen, Li-Ju1 aKuo, Ching-Chin uhttp://apm.sagepub.com/content/36/2/75.abstract01288nas a2200109 4500008004500000245009100045210006900136490000700205520083400212100001501046856011701061 2012 Engldsh 00aItem Overexposure in Computerized Classification Tests Using Sequential Item Selection0 aItem Overexposure in Computerized Classification Tests Using Seq0 v173 a

Computerized classification tests (CCTs) often use sequential item selection which administers items according to maximizing psychometric information at a cut point demarcating passing and failing scores. This paper illustrates why this method of item selection leads to the overexposure of a significant number of items, and the performances of three different methods for controlling maximum item exposure rates in CCTs are compared. Specifically, the Sympson-Hetter, restricted, and item eligibility methods are examined in two studies realistically simulating different types of CCTs and are evaluated based upon criteria including classification accuracy, the number of items exceeding the desired maximum exposure rate, and test overlap. The pros and cons of each method are discussed from a practical perspective.

1 aHuebner, A uhttp://www.iacat.org/content/item-overexposure-computerized-classification-tests-using-sequential-item-selection00442nas a2200121 4500008003900000245008600039210006900125300001200194490000700206100001800213700002100231856006800252 2012 d00aItem Selection and Ability Estimation Procedures for a Mixed-Format Adaptive Test0 aItem Selection and Ability Estimation Procedures for a MixedForm a305-3260 v251 aHo, Tsung-Han1 aDodd, Barbara, G uhttp://www.tandfonline.com/doi/abs/10.1080/08957347.2012.71468601899nas a2200157 4500008003900000245009300039210007100132300001200203490000700215520139800222100001401620700002101634700001601655700001701671856005301688 2012 d00aA Mixture Rasch Model–Based Computerized Adaptive Test for Latent Class Identification0 aMixture Rasch Model–Based Computerized Adaptive Test for Latent  a469-4930 v363 a

This study explored a computerized adaptive test delivery algorithm for latent class identification based on the mixture Rasch model. Four item selection methods based on the Kullback–Leibler (KL) information were proposed and compared with the reversed and the adaptive KL information under simulated testing conditions. When item separation was large, all item selection methods did not differ evidently in terms of accuracy in classifying examinees into different latent classes and estimating latent ability. However, when item separation was small, two methods with class-specific ability estimates performed better than the other two methods based on a single latent ability estimate across all latent classes. The three types of KL information distributions were compared. The KL and the reversed KL information could be the same or different depending on the ability level and the item difficulty difference between latent classes. Although the KL information and the reversed KL information were different at some ability levels and item difficulty difference levels, the use of the KL, the reversed KL, or the adaptive KL information did not affect the results substantially due to the symmetric distribution of item difficulty differences between latent classes in the simulated item pools. Item pool usage and classification convergence points were examined as well.

1 aHong Jiao1 aMacready, George1 aLiu, Junhui1 aCho, Youngmi uhttp://apm.sagepub.com/content/36/6/469.abstract01222nas a2200157 4500008003900000245013900039210006900178300001200247490000700259520066600266100002100932700001900953700001500972700002400987856005301011 2012 d00aOn the Reliability and Validity of a Numerical Reasoning Speed Dimension Derived From Response Times Collected in Computerized Testing0 aReliability and Validity of a Numerical Reasoning Speed Dimensio a245-2630 v723 a

Data from 181 college students were used to assess whether math reasoning item response times in computerized testing can provide valid and reliable measures of a speed dimension. The alternate forms reliability of the speed dimension was .85. A two-dimensional structural equation model suggests that the speed dimension is related to the accuracy of speeded responses. Speed factor scores were significantly correlated with performance on the ACT math scale. Results suggest that the speed dimension underlying response times can be reliably measured and that the dimension is related to the accuracy of performance under the pressure of time limits.

1 aDavison, Mark, L1 aSemmes, Robert1 aHuang, Lan1 aClose, Catherine, N uhttp://epm.sagepub.com/content/72/2/245.abstract01281nas a2200133 4500008003900000245009500039210006900134300001200203490000700215520083800222100001801060700001601078856005301094 2012 d00aA Stochastic Method for Balancing Item Exposure Rates in Computerized Classification Tests0 aStochastic Method for Balancing Item Exposure Rates in Computeri a181-1880 v363 a

Computerized classification tests (CCTs) classify examinees into categories such as pass/fail, master/nonmaster, and so on. This article proposes the use of stochastic methods from sequential analysis to address item overexposure, a practical concern in operational CCTs. Item overexposure is traditionally dealt with in CCTs by the Sympson-Hetter (SH) method, but this method is unable to restrict the exposure of the most informative items to the desired level. The authors’ new method of stochastic item exposure balance (SIEB) works in conjunction with the SH method and is shown to greatly reduce the number of overexposed items in a pool and improve overall exposure balance while maintaining classification accuracy comparable with using the SH method alone. The method is demonstrated using a simulation study.

1 aHuebner, Alan1 aLi, Zhushan uhttp://apm.sagepub.com/content/36/3/181.abstract01281nas a2200133 4500008003900000245009500039210006900134300001200203490000700215520083800222100001801060700001601078856005301094 2012 d00aA Stochastic Method for Balancing Item Exposure Rates in Computerized Classification Tests0 aStochastic Method for Balancing Item Exposure Rates in Computeri a181-1880 v363 a

Computerized classification tests (CCTs) classify examinees into categories such as pass/fail, master/nonmaster, and so on. This article proposes the use of stochastic methods from sequential analysis to address item overexposure, a practical concern in operational CCTs. Item overexposure is traditionally dealt with in CCTs by the Sympson-Hetter (SH) method, but this method is unable to restrict the exposure of the most informative items to the desired level. The authors’ new method of stochastic item exposure balance (SIEB) works in conjunction with the SH method and is shown to greatly reduce the number of overexposed items in a pool and improve overall exposure balance while maintaining classification accuracy comparable with using the SH method alone. The method is demonstrated using a simulation study.

1 aHuebner, Alan1 aLi, Zhushan uhttp://apm.sagepub.com/content/36/3/181.abstract01976nas a2200133 4500008003900000245011600039210006900155300001200224490000700236520150500243100002001748700002101768856005301789 2011 d00aComputerized Classification Testing Under the One-Parameter Logistic Response Model With Ability-Based Guessing0 aComputerized Classification Testing Under the OneParameter Logis a925-9410 v713 a

The one-parameter logistic model with ability-based guessing (1PL-AG) has been recently developed to account for effect of ability on guessing behavior in multiple-choice items. In this study, the authors developed algorithms for computerized classification testing under the 1PL-AG and conducted a series of simulations to evaluate their performances. Four item selection methods (the Fisher information, the Fisher information with a posterior distribution, the progressive method, and the adjusted progressive method) and two termination criteria (the ability confidence interval [ACI] method and the sequential probability ratio test [SPRT]) were developed. In addition, the Sympson–Hetter online method with freeze (SHOF) was implemented for item exposure control. Major results include the following: (a) when no item exposure control was made, all the four item selection methods yielded very similar correct classification rates, but the Fisher information method had the worst item bank usage and the highest item exposure rate; (b) SHOF can successfully maintain the item exposure rate at a prespecified level, without compromising substantial accuracy and efficiency in classification; (c) once SHOF was implemented, all the four methods performed almost identically; (d) ACI appeared to be slightly more efficient than SPRT; and (e) in general, a higher weight of ability in guessing led to a slightly higher accuracy and efficiency, and a lower forced classification rate.

1 aWang, Wen-Chung1 aHuang, Sheng-Yun uhttp://epm.sagepub.com/content/71/6/925.abstract01695nas a2200217 4500008004100000020004600041245012100087210006900208250001500277300001100292490000700303520094700310100001701257700001301274700001601287700001001303700001201313700001601325700001801341856011801359 2011 eng d a1541-3144 (Electronic)0194-2638 (Linking)00aContent range and precision of a computer adaptive test of upper extremity function for children with cerebral palsy0 aContent range and precision of a computer adaptive test of upper a2010/10/15 a90-1020 v313 aThis article reports on the content range and measurement precision of an upper extremity (UE) computer adaptive testing (CAT) platform of physical function in children with cerebral palsy. Upper extremity items representing skills of all abilities were administered to 305 parents. These responses were compared with two traditional standardized measures: Pediatric Outcomes Data Collection Instrument and Functional Independence Measure for Children. The UE CAT correlated strongly with the upper extremity component of these measures and had greater precision when describing individual functional ability. The UE item bank has wider range with items populating the lower end of the ability spectrum. This new UE item bank and CAT have the capability to quickly assess children of all ages and abilities with good precision and, most importantly, with items that are meaningful and appropriate for their age and level of physical function.1 aMontpetit, K1 aHaley, S1 aBilodeau, N1 aNi, P1 aTian, F1 aGorton, 3rd1 aMulcahey, M J uhttp://www.iacat.org/content/content-range-and-precision-computer-adaptive-test-upper-extremity-function-children02592nas a2200313 4500008004100000020004600041245011200087210006900199250001500268260001900283300000700302490000600309520160100315100001901916700001801935700001701953700001801970700001701988700001402005700001602019700001502035700001402050700002602064700001602090700001302106700001502119700001902134856012502153 2011 Eng d a1477-7525 (Electronic)1477-7525 (Linking)00aCross-cultural development of an item list for computer-adaptive testing of fatigue in oncological patients0 aCrosscultural development of an item list for computeradaptive t a2011/03/31 cMarch 29, 2011 a100 v93 aABSTRACT: INTRODUCTION: Within an ongoing project of the EORTC Quality of Life Group, we are developing computerized adaptive test (CAT) measures for the QLQ-C30 scales. These new CAT measures are conceptualised to reflect the same constructs as the QLQ-C30 scales. Accordingly, the Fatigue-CAT is intended to capture physical and general fatigue. METHODS: The EORTC approach to CAT development comprises four phases (literature search, operationalisation, pre-testing, and field testing). Phases I-III are described in detail in this paper. A literature search for fatigue items was performed in major medical databases. After refinement through several expert panels, the remaining items were used as the basis for adapting items and/or formulating new items fitting the EORTC item style. To obtain feedback from patients with cancer, these English items were translated into Danish, French, German, and Spanish and tested in the respective countries. RESULTS: Based on the literature search a list containing 588 items was generated. After a comprehensive item selection procedure focusing on content, redundancy, item clarity and item difficulty a list of 44 fatigue items was generated. Patient interviews (n=52) resulted in 12 revisions of wording and translations. DISCUSSION: The item list developed in phases I-III will be further investigated within a field-testing phase (IV) to examine psychometric characteristics and to fit an item response theory model. The Fatigue CAT based on this item bank will provide scores that are backward-compatible to the original QLQ-C30 fatigue scale.1 aGiesinger, J M1 aPetersen, M A1 aGroenvold, M1 aAaronson, N K1 aArraras, J I1 aConroy, T1 aGamper, E M1 aKemmler, G1 aKing, M T1 aOberguggenberger, A S1 aVelikova, G1 aYoung, T1 aHolzner, B1 aEortc-Qlg, E O uhttp://www.iacat.org/content/cross-cultural-development-item-list-computer-adaptive-testing-fatigue-oncological-patients00774nas a2200145 4500008004100000245005700041210005700098260001200155520031700167653001500484100001700499700001300516700001900529856008000548 2011 eng d00aImpact of Item Drift on Candidate Ability Estimation0 aImpact of Item Drift on Candidate Ability Estimation c10/20113 a

For large operational pools, candidate ability estimates appear robust to item drift, especially under conditions that may represent ‘normal’ amounts of drift. Even with ‘extreme’ conditions of drift (e.g., 20% of items drifting 1.00 logits), decision consistency was still high.

10aitem drift1 aHagge, Sarah1 aWoo, Ada1 aDickison, Phil uhttp://www.iacat.org/content/impact-item-drift-candidate-ability-estimation01369nas a2200157 4500008003900000022001400039245010400053210006900157300001400226490000700240520085700247100001501104700001901119700001801138856005501156 2011 d a1745-398400aRestrictive Stochastic Item Selection Methods in Cognitive Diagnostic Computerized Adaptive Testing0 aRestrictive Stochastic Item Selection Methods in Cognitive Diagn a255–2730 v483 a

This paper proposes two new item selection methods for cognitive diagnostic computerized adaptive testing: the restrictive progressive method and the restrictive threshold method. They are built upon the posterior weighted Kullback-Leibler (KL) information index but include additional stochastic components either in the item selection index or in the item selection procedure. Simulation studies show that both methods are successful at simultaneously suppressing overexposed items and increasing the usage of underexposed items. Compared to item selection based upon (1) pure KL information and (2) the Sympson-Hetter method, the two new methods strike a better balance between item exposure control and measurement accuracy. The two new methods are also compared with Barrada et al.'s (2008) progressive method and proportional method.

1 aWang, Chun1 aChang, Hua-Hua1 aHuebner, Alan uhttp://dx.doi.org/10.1111/j.1745-3984.2011.00145.x00444nas a2200121 4500008004100000245006700041210006700108300001200175100001800187700001300205700001400218856009000232 2010 eng d00aAssembling an Inventory of Multistage Adaptive Testing Systems0 aAssembling an Inventory of Multistage Adaptive Testing Systems a247-2661 aBreithaupt, K1 aAriel, A1 aHare, D R uhttp://www.iacat.org/content/assembling-inventory-multistage-adaptive-testing-systems00557nas a2200157 4500008004100000245008700041210006900128300001400197490001000211100001300221700001200234700001400246700001400260700001400274856011100288 2010 eng d00aDevelopment and evaluation of a confidence-weighting computerized adaptive testing0 aDevelopment and evaluation of a confidenceweighting computerized a163–1760 v13(3)1 aYen, Y C1 aHo, R G1 aChen, L J1 aChou, K Y1 aChen, Y L uhttp://www.iacat.org/content/development-and-evaluation-confidence-weighting-computerized-adaptive-testing02223nas a2200289 4500008004100000020004600041245010800087210006900195250001500264300001200279490000700291520131000298100001801608700001701626700001801643700001401661700001401675700001801689700001401707700001701721700001501738700001301753700001401766700001601780700001301796856012401809 2010 Eng d a1573-2649 (Electronic)0962-9343 (Linking)00aDevelopment of computerized adaptive testing (CAT) for the EORTC QLQ-C30 physical functioning dimension0 aDevelopment of computerized adaptive testing CAT for the EORTC Q a2010/10/26 a479-4900 v203 aPURPOSE: Computerized adaptive test (CAT) methods, based on item response theory (IRT), enable a patient-reported outcome instrument to be adapted to the individual patient while maintaining direct comparability of scores. The EORTC Quality of Life Group is developing a CAT version of the widely used EORTC QLQ-C30. We present the development and psychometric validation of the item pool for the first of the scales, physical functioning (PF). METHODS: Initial developments (including literature search and patient and expert evaluations) resulted in 56 candidate items. Responses to these items were collected from 1,176 patients with cancer from Denmark, France, Germany, Italy, Taiwan, and the United Kingdom. The items were evaluated with regard to psychometric properties. RESULTS: Evaluations showed that 31 of the items could be included in a unidimensional IRT model with acceptable fit and good content coverage, although the pool may lack items at the upper extreme (good PF). There were several findings of significant differential item functioning (DIF). However, the DIF findings appeared to have little impact on the PF estimation. CONCLUSIONS: We have established an item pool for CAT measurement of PF and believe that this CAT instrument will clearly improve the EORTC measurement of PF.1 aPetersen, M A1 aGroenvold, M1 aAaronson, N K1 aChie, W C1 aConroy, T1 aCostantini, A1 aFayers, P1 aHelbostad, J1 aHolzner, B1 aKaasa, S1 aSinger, S1 aVelikova, G1 aYoung, T uhttp://www.iacat.org/content/development-computerized-adaptive-testing-cat-eortc-qlq-c30-physical-functioning-dimension00605nas a2200157 4500008004100000245011500041210006900156300001400225490001000239100001200249700001500261700001800276700001400294700001300308856012600321 2010 eng d00aEfficiency of static and computer adaptive short forms compared to full-length measures of depressive symptoms0 aEfficiency of static and computer adaptive short forms compared  a125–1360 v19(1)1 aChoi, S1 aReise, S P1 aPilkonis, P A1 aHays, R D1 aCella, D uhttp://www.iacat.org/content/efficiency-static-and-computer-adaptive-short-forms-compared-full-length-measures-depressive00414nas a2200133 4500008004100000245004600041210004600087300001200133100001800145700001600163700001300179700001700192856007100209 2010 eng d00aInnovative Items for Computerized Testing0 aInnovative Items for Computerized Testing a215-2301 aParshall, C G1 aHarmes, J C1 aDavey, T1 aPashley, P J uhttp://www.iacat.org/content/innovative-items-computerized-testing00481nas a2200109 4500008004100000245010100041210006900142300001200211100001400223700001500237856011900252 2010 eng d00aA Japanese Adaptive Test of English as a Foreign Language: Developmental and Operational Aspects0 aJapanese Adaptive Test of English as a Foreign Language Developm a191-2111 aNogami, Y1 aHayashi, N uhttp://www.iacat.org/content/japanese-adaptive-test-english-foreign-language-developmental-and-operational-aspects00410nas a2200121 4500008004100000245005400041210005100095300001200146100001700158700001800175700001500193856008000208 2010 eng d00aMultistage Testing: Issues, Designs, and Research0 aMultistage Testing Issues Designs and Research a355-3721 aZenisky, A L1 aHambleton, RK1 aLuecht, RM uhttp://www.iacat.org/content/multistage-testing-issues-designs-and-research00336nas a2200085 4500008004100000245009100041210006900132100001300201856003600214 2010 eng d00aSimulCAT: Windows application that simulates computerized adaptive test administration0 aSimulCAT Windows application that simulates computerized adaptiv1 aHan, K T uhttp://www.hantest.net/simulcat01857nas a2200181 4500008004100000020001400041245011000055210006900165300001200234490000700246520122300253100001601476700001601492700001601508700001201524700001301536856012601549 2010 eng d a1529-771300aThe use of PROMIS and assessment center to deliver patient-reported outcome measures in clinical research0 ause of PROMIS and assessment center to deliver patientreported o a304-3140 v113 aThe Patient-Reported Outcomes Measurement Information System (PROMIS) was developed as one of the first projects funded by the NIH Roadmap for Medical Research Initiative to re-engineer the clinical research enterprise. The primary goal of PROMIS is to build item banks and short forms that measure key health outcome domains that are manifested in a variety of chronic diseases which could be used as a "common currency" across research projects. To date, item banks, short forms and computerized adaptive tests (CAT) have been developed for 13 domains with relevance to pediatric and adult subjects. To enable easy delivery of these new instruments, PROMIS built a web-based resource (Assessment Center) for administering CATs and other self-report data, tracking item and instrument development, monitoring accrual, managing data, and storing statistical analysis results. Assessment Center can also be used to deliver custom researcher developed content, and has numerous features that support both simple and complicated accrual designs (branching, multiple arms, multiple time points, etc.). This paper provides an overview of the development of the PROMIS item banks and details Assessment Center functionality.1 aGershon, RC1 aRothrock, N1 aHanrahan, R1 aBass, M1 aCella, D uhttp://www.iacat.org/content/use-promis-and-assessment-center-deliver-patient-reported-outcome-measures-clinical-research02651nas a2200181 4500008004100000020001400041245007900055210006900134300001000203490000700213520201300220653005202233653004002285100001502325700001302340700001502353856010102368 2009 eng d a0360-131500aAn adaptive testing system for supporting versatile educational assessment0 aadaptive testing system for supporting versatile educational ass a53-670 v523 aWith the rapid growth of computer and mobile technology, it is a challenge to integrate computer based test (CBT) with mobile learning (m-learning) especially for formative assessment and self-assessment. In terms of self-assessment, computer adaptive test (CAT) is a proper way to enable students to evaluate themselves. In CAT, students are assessed through a process that uses item response theory (IRT), a well-founded psychometric theory. Furthermore, a large item bank is indispensable to a test, but when a CAT system has a large item bank, the test item selection of IRT becomes more tedious. Besides the large item bank, item exposure mechanism is also essential to a testing system. However, IRT all lack the above-mentioned points. These reasons have motivated the authors to carry out this study. This paper describes a design issue aimed at the development and implementation of an adaptive testing system. The system can support several assessment functions and different devices. Moreover, the researchers apply a novel approach, particle swarm optimization (PSO) to alleviate the computational complexity and resolve the problem of item exposure. Throughout the development of the system, a formative evaluation was embedded into an integral part of the design methodology that was used for improving the system. After the system was formally released onto the web, some questionnaires and experiments were conducted to evaluate the usability, precision, and efficiency of the system. The results of these evaluations indicated that the system provides an adaptive testing for different devices and supports versatile assessment functions. Moreover, the system can estimate students' ability reliably and validly and conduct an adaptive test efficiently. Furthermore, the computational complexity of the system was alleviated by the PSO approach. By the approach, the test item selection procedure becomes efficient and the average best fitness values are very close to the optimal solutions.10aArchitectures for educational technology system10aDistance education and telelearning1 aHuang, Y-M1 aLin, Y-T1 aCheng, S-C uhttp://www.iacat.org/content/adaptive-testing-system-supporting-versatile-educational-assessment01893nas a2200157 4500008004100000245007800041210006900119260009700188520126000285100001801545700001801563700002001581700001701601700001601618856010101634 2009 eng d00aCriterion-related validity of an innovative CAT-based personality measure0 aCriterionrelated validity of an innovative CATbased personality  aD. J. Weiss (Ed.), Proceedings of the 2009 GMAC Conference on Computerized Adaptive Testing.3 aThis paper describes development and initial criterion-related validation of the PreVisor Computer Adaptive Personality Scales (PCAPS), a computerized adaptive testing-based personality measure that uses an ideal point IRT model based on forced-choice, paired-comparison responses. Based on results from a large consortium study, a composite of six PCAPS scales identified as relevant to the population of interest (first-line supervisors) had an estimated operational validity against an overall job performance criterion of ρ = .25. Uncorrected and corrected criterion-related validity results for each of the six PCAPS scales making up the composite are also reported. Because the PCAPS algorithm computes intermediate scale scores until a stopping rule is triggered, we were able to graph number of statement-pairs presented against criterion-related validities. Results showed generally monotonically increasing functions. However, asymptotic validity levels, or at least a reduction in the rate of increase in slope, were often reached after 5-7 statement-pairs were presented. In the case of the composite measure, there was some evidence that validities decreased after about six statement-pairs. A possible explanation for this is provided.1 aSchneider, RJ1 aMcLellan, R A1 aKantrowitz, T M1 aHouston, J S1 aBorman, W C uhttp://www.iacat.org/content/criterion-related-validity-innovative-cat-based-personality-measure00567nas a2200133 4500008004400000245013200044210007000176300001000246490000700256100001200263700001400275700001900289856012500308 2009 Germdn 00aEffekte des adaptiven Testens auf die Moti¬vation zur Testbearbeitung [Effects of adaptive testing on test taking motivation].0 aEffekte des adaptiven Testens auf die Moti¬vation zur Testbearbe a20-280 v551 aFrey, A1 aHartig, J1 aMoosbrugger, H uhttp://www.iacat.org/content/effekte-des-adaptiven-testens-auf-die-moti%C2%ACvation-zur-testbearbeitung-effects-adaptive00633nas a2200181 4500008004100000245006000041210005700101260009700158100001200255700001100267700001600278700001500294700001300309700001600322700001300338700001600351856008400367 2009 eng d00aFeatures of J-CAT (Japanese Computerized Adaptive Test)0 aFeatures of JCAT Japanese Computerized Adaptive Test aD. J. Weiss (Ed.), Proceedings of the 2009 GMAC Conference on Computerized Adaptive Testing.1 aImai, S1 aIto, S1 aNakamura, Y1 aKikuchi, K1 aAkagi, Y1 aNakasono, H1 aHonda, A1 aHiramura, T uhttp://www.iacat.org/content/features-j-cat-japanese-computerized-adaptive-test00500nas a2200097 4500008004100000245009800041210006900139260006000208100001300268856012100281 2009 eng d00aGradual maximum information ratio approach to item selection in computerized adaptive testing0 aGradual maximum information ratio approach to item selection in  aMcLean, VA. USAbGraduate Management Admissions Council1 aHan, K T uhttp://www.iacat.org/content/gradual-maximum-information-ratio-approach-item-selection-computerized-adaptive-testing00541nas a2200097 4500008004100000245010000041210006900141260009700210100001300307856012300320 2009 eng d00aA gradual maximum information ratio approach to item selection in computerized adaptive testing0 agradual maximum information ratio approach to item selection in  aD. J. Weiss (Ed.), Proceedings of the 2009 GMAC Conference on Computerized Adaptive Testing.1 aHan, K T uhttp://www.iacat.org/content/gradual-maximum-information-ratio-approach-item-selection-computerized-adaptive-testing-003147nas a2200457 4500008004100000020004100041245015500082210006900237250001500306260000800321300001200329490000700341520174100348653002502089653001902114653002502133653003002158653001502188653003602203653001002239653002102249653003302270653001102303653001102314653000902325653001802334653001702352653001902369653001602388100001502404700001002419700001502429700002502444700001802469700001702487700001602504700001602520700001402536700001602550856012302566 2009 eng d a0962-9343 (Print)0962-9343 (Linking)00aMeasuring global physical health in children with cerebral palsy: Illustration of a multidimensional bi-factor model and computerized adaptive testing0 aMeasuring global physical health in children with cerebral palsy a2009/02/18 cApr a359-3700 v183 aPURPOSE: The purposes of this study were to apply a bi-factor model for the determination of test dimensionality and a multidimensional CAT using computer simulations of real data for the assessment of a new global physical health measure for children with cerebral palsy (CP). METHODS: Parent respondents of 306 children with cerebral palsy were recruited from four pediatric rehabilitation hospitals and outpatient clinics. We compared confirmatory factor analysis results across four models: (1) one-factor unidimensional; (2) two-factor multidimensional (MIRT); (3) bi-factor MIRT with fixed slopes; and (4) bi-factor MIRT with varied slopes. We tested whether the general and content (fatigue and pain) person score estimates could discriminate across severity and types of CP, and whether score estimates from a simulated CAT were similar to estimates based on the total item bank, and whether they correlated as expected with external measures. RESULTS: Confirmatory factor analysis suggested separate pain and fatigue sub-factors; all 37 items were retained in the analyses. From the bi-factor MIRT model with fixed slopes, the full item bank scores discriminated across levels of severity and types of CP, and compared favorably to external instruments. CAT scores based on 10- and 15-item versions accurately captured the global physical health scores. CONCLUSIONS: The bi-factor MIRT CAT application, especially the 10- and 15-item versions, yielded accurate global physical health scores that discriminated across known severity groups and types of CP, and correlated as expected with concurrent measures. The CATs have potential for collecting complex data on the physical health of children with CP in an efficient manner.10a*Computer Simulation10a*Health Status10a*Models, Statistical10aAdaptation, Psychological10aAdolescent10aCerebral Palsy/*physiopathology10aChild10aChild, Preschool10aFactor Analysis, Statistical10aFemale10aHumans10aMale10aMassachusetts10aPennsylvania10aQuestionnaires10aYoung Adult1 aHaley, S M1 aNi, P1 aDumas, H M1 aFragala-Pinkham, M A1 aHambleton, RK1 aMontpetit, K1 aBilodeau, N1 aGorton, G E1 aWatson, K1 aTucker, C A uhttp://www.iacat.org/content/measuring-global-physical-health-children-cerebral-palsy-illustration-multidimensional-bi00538nas a2200121 4500008004100000245007800041210006900119260009700188100001500285700001200300700001100312856009300323 2009 eng d00aPractical issues concerning the application of the DINA model to CAT data0 aPractical issues concerning the application of the DINA model to aD. J. Weiss (Ed.), Proceedings of the 2009 GMAC Conference on Computerized Adaptive Testing.1 aHuebner, A1 aWang, B1 aLee, S uhttp://www.iacat.org/content/practical-issues-concerning-application-dina-model-cat-data02435nas a2200385 4500008004100000020004100041245009300082210006900175250001500244260000800259300001100267490000700278520128100285653003201566653002701598653002001625653002901645653001001674653000901684653001901693653003401712653001101746653001101757653000901768653001601777653004601793100001501839700001001854700001501864700001101879700001201890700001401902700001601916856011701932 2009 eng d a0962-9343 (Print)0962-9343 (Linking)00aReplenishing a computerized adaptive test of patient-reported daily activity functioning0 aReplenishing a computerized adaptive test of patientreported dai a2009/03/17 cMay a461-710 v183 aPURPOSE: Computerized adaptive testing (CAT) item banks may need to be updated, but before new items can be added, they must be linked to the previous CAT. The purpose of this study was to evaluate 41 pretest items prior to including them into an operational CAT. METHODS: We recruited 6,882 patients with spine, lower extremity, upper extremity, and nonorthopedic impairments who received outpatient rehabilitation in one of 147 clinics across 13 states of the USA. Forty-one new Daily Activity (DA) items were administered along with the Activity Measure for Post-Acute Care Daily Activity CAT (DA-CAT-1) in five separate waves. We compared the scoring consistency with the full item bank, test information function (TIF), person standard errors (SEs), and content range of the DA-CAT-1 to the new CAT (DA-CAT-2) with the pretest items by real data simulations. RESULTS: We retained 29 of the 41 pretest items. Scores from the DA-CAT-2 were more consistent (ICC = 0.90 versus 0.96) than DA-CAT-1 when compared with the full item bank. TIF and person SEs were improved for persons with higher levels of DA functioning, and ceiling effects were reduced from 16.1% to 6.1%. CONCLUSIONS: Item response theory and online calibration methods were valuable in improving the DA-CAT.10a*Activities of Daily Living10a*Disability Evaluation10a*Questionnaires10a*User-Computer Interface10aAdult10aAged10aCohort Studies10aComputer-Assisted Instruction10aFemale10aHumans10aMale10aMiddle Aged10aOutcome Assessment (Health Care)/*methods1 aHaley, S M1 aNi, P1 aJette, A M1 aTao, W1 aMoed, R1 aMeyers, D1 aLudlow, L H uhttp://www.iacat.org/content/replenishing-computerized-adaptive-test-patient-reported-daily-activity-functioning02865nas a2200325 4500008004100000020002700041245007400068210006900142250001500211260000800226300001100234490000700245520188300252653003202135653003202167653002502199653002302224653004802247653001102295653001102306653000902317653001602326653001902342653002702361100001502388700001502403700001002418700001202428856009902440 2008 eng d a1537-7385 (Electronic)00aAdaptive short forms for outpatient rehabilitation outcome assessment0 aAdaptive short forms for outpatient rehabilitation outcome asses a2008/09/23 cOct a842-520 v873 aOBJECTIVE: To develop outpatient Adaptive Short Forms for the Activity Measure for Post-Acute Care item bank for use in outpatient therapy settings. DESIGN: A convenience sample of 11,809 adults with spine, lower limb, upper limb, and miscellaneous orthopedic impairments who received outpatient rehabilitation in 1 of 127 outpatient rehabilitation clinics in the United States. We identified optimal items for use in developing outpatient Adaptive Short Forms based on the Basic Mobility and Daily Activities domains of the Activity Measure for Post-Acute Care item bank. Patient scores were derived from the Activity Measure for Post-Acute Care computerized adaptive testing program. Items were selected for inclusion on the Adaptive Short Forms based on functional content, range of item coverage, measurement precision, item exposure rate, and data collection burden. RESULTS: Two outpatient Adaptive Short Forms were developed: (1) an 18-item Basic Mobility Adaptive Short Form and (2) a 15-item Daily Activities Adaptive Short Form, derived from the same item bank used to develop the Activity Measure for Post-Acute Care computerized adaptive testing program. Both Adaptive Short Forms achieved acceptable psychometric properties. CONCLUSIONS: In outpatient postacute care settings where computerized adaptive testing outcome applications are currently not feasible, item response theory-derived Adaptive Short Forms provide the efficient capability to monitor patients' functional outcomes. The development of Adaptive Short Form functional outcome instruments linked by a common, calibrated item bank has the potential to create a bridge to outcome monitoring across postacute care settings and can facilitate the eventual transformation from Adaptive Short Forms to computerized adaptive testing applications easier and more acceptable to the rehabilitation community.10a*Activities of Daily Living10a*Ambulatory Care Facilities10a*Mobility Limitation10a*Treatment Outcome10aDisabled Persons/psychology/*rehabilitation10aFemale10aHumans10aMale10aMiddle Aged10aQuestionnaires10aRehabilitation Centers1 aJette, A M1 aHaley, S M1 aNi, P1 aMoed, R uhttp://www.iacat.org/content/adaptive-short-forms-outpatient-rehabilitation-outcome-assessment00717nas a2200229 4500008004100000020004100041245005200082210005100134250001500185260000800200300000800208490000700216653003400223653005000257653001100307653003200318653001300350100001500363700001500378700001800393856007600411 2008 eng d a1075-2730 (Print)1075-2730 (Linking)00aAre we ready for computerized adaptive testing?0 aAre we ready for computerized adaptive testing a2008/04/02 cApr a3690 v5910a*Attitude of Health Personnel10a*Diagnosis, Computer-Assisted/instrumentation10aHumans10aMental Disorders/*diagnosis10aSoftware1 aUnick, G J1 aShumway, M1 aHargreaves, W uhttp://www.iacat.org/content/are-we-ready-computerized-adaptive-testing03436nas a2200481 4500008004100000020004600041245013800087210006900225250001500294260000800309300001200317490000700329520191400336653002702250653002302277653003102300653001502331653001602346653001002362653002102372653002402393653002302417653003802440653001102478653002202489653001102511653001102522653000902533653003702542653002102579653003102600653002602631653001702657653003202674653001602706653002802722100001602750700001502766700001002781700001502791700002502806856012302831 2008 eng d a1532-821X (Electronic)0003-9993 (Linking)00aAssessing self-care and social function using a computer adaptive testing version of the pediatric evaluation of disability inventory0 aAssessing selfcare and social function using a computer adaptive a2008/04/01 cApr a622-6290 v893 aOBJECTIVE: To examine score agreement, validity, precision, and response burden of a prototype computer adaptive testing (CAT) version of the self-care and social function scales of the Pediatric Evaluation of Disability Inventory compared with the full-length version of these scales. DESIGN: Computer simulation analysis of cross-sectional and longitudinal retrospective data; cross-sectional prospective study. SETTING: Pediatric rehabilitation hospital, including inpatient acute rehabilitation, day school program, outpatient clinics; community-based day care, preschool, and children's homes. PARTICIPANTS: Children with disabilities (n=469) and 412 children with no disabilities (analytic sample); 38 children with disabilities and 35 children without disabilities (cross-validation sample). INTERVENTIONS: Not applicable. MAIN OUTCOME MEASURES: Summary scores from prototype CAT applications of each scale using 15-, 10-, and 5-item stopping rules; scores from the full-length self-care and social function scales; time (in seconds) to complete assessments and respondent ratings of burden. RESULTS: Scores from both computer simulations and field administration of the prototype CATs were highly consistent with scores from full-length administration (r range, .94-.99). Using computer simulation of retrospective data, discriminant validity, and sensitivity to change of the CATs closely approximated that of the full-length scales, especially when the 15- and 10-item stopping rules were applied. In the cross-validation study the time to administer both CATs was 4 minutes, compared with over 16 minutes to complete the full-length scales. CONCLUSIONS: Self-care and social function score estimates from CAT administration are highly comparable with those obtained from full-length scale administration, with small losses in validity and precision and substantial decreases in administration time.10a*Disability Evaluation10a*Social Adjustment10aActivities of Daily Living10aAdolescent10aAge Factors10aChild10aChild, Preschool10aComputer Simulation10aCross-Over Studies10aDisabled Children/*rehabilitation10aFemale10aFollow-Up Studies10aHumans10aInfant10aMale10aOutcome Assessment (Health Care)10aReference Values10aReproducibility of Results10aRetrospective Studies10aRisk Factors10aSelf Care/*standards/trends10aSex Factors10aSickness Impact Profile1 aCoster, W J1 aHaley, S M1 aNi, P1 aDumas, H M1 aFragala-Pinkham, M A uhttp://www.iacat.org/content/assessing-self-care-and-social-function-using-computer-adaptive-testing-version-pediatric01669nas a2200169 4500008003900000245009500039210007100134300000900205490000700214520113900221100001701360700001401377700002201391700001901413700001601432856005101448 2008 d00aComparability of Computer-Based and Paper-and-Pencil Testing in K–12 Reading Assessments0 aComparability of ComputerBased and PaperandPencil Testing in K–1 a5-240 v683 a

In recent years, computer-based testing (CBT) has grown in popularity, is increasingly being implemented across the United States, and will likely become the primary mode for delivering tests in the future. Although CBT offers many advantages over traditional paper-and-pencil testing, assessment experts, researchers, practitioners, and users have expressed concern about the comparability of scores between the two test administration modes. To help provide an answer to this issue, a meta-analysis was conducted to synthesize the administration mode effects of CBTs and paper-and-pencil tests on K—12 student reading assessments. Findings indicate that the administration mode had no statistically significant effect on K—12 student reading achievement scores. Four moderator variables—study design, sample size, computer delivery algorithm, and computer practice—made statistically significant contributions to predicting effect size. Three moderator variables—grade level, type of test, and computer delivery method—did not affect the differences in reading scores between test modes.

1 aShudong Wang1 aHong Jiao1 aYoung, Michael, J1 aBrooks, Thomas1 aOlson, John uhttp://epm.sagepub.com/content/68/1/5.abstract01113nas a2200133 4500008003900000245011000039210006900149300001200218490000700230520065500237100001700892700001700909856005300926 2008 d00aComputer-Based and Paper-and-Pencil Administration Mode Effects on a Statewide End-of-Course English Test0 aComputerBased and PaperandPencil Administration Mode Effects on  a554-5700 v683 a

The current study compared student performance between paper-and-pencil testing (PPT) and computer-based testing (CBT) on a large-scale statewide end-of-course English examination. Analyses were conducted at both the item and test levels. The overall results suggest that scores obtained from PPT and CBT were comparable. However, at the content domain level, a rather large difference in the reading comprehension section suggests that reading comprehension test may be more affected by the test administration mode. Results from the confirmatory factor analysis suggest that the administration mode did not alter the construct of the test.

1 aKim, Do-Hong1 aHuynh, Huynh uhttp://epm.sagepub.com/content/68/4/554.abstract03041nas a2200481 4500008004100000020004600041245012200087210006900209250001500278260000800293300001200301490000700313520155700320653003201877653003101909653002201940653002001962653001001982653000901992653002202001653002802023653003302051653001102084653001102095653002502106653000902131653001602140653004602156653002202202653002402224653003002248653002902278100001502307700001402322700001502336700002402351700001802375700001102393700001602404700001002420700001502430856011402445 2008 eng d a1532-821X (Electronic)0003-9993 (Linking)00aComputerized adaptive testing for follow-up after discharge from inpatient rehabilitation: II. Participation outcomes0 aComputerized adaptive testing for followup after discharge from  a2008/01/30 cFeb a275-2830 v893 aOBJECTIVES: To measure participation outcomes with a computerized adaptive test (CAT) and compare CAT and traditional fixed-length surveys in terms of score agreement, respondent burden, discriminant validity, and responsiveness. DESIGN: Longitudinal, prospective cohort study of patients interviewed approximately 2 weeks after discharge from inpatient rehabilitation and 3 months later. SETTING: Follow-up interviews conducted in patient's home setting. PARTICIPANTS: Adults (N=94) with diagnoses of neurologic, orthopedic, or medically complex conditions. INTERVENTIONS: Not applicable. MAIN OUTCOME MEASURES: Participation domains of mobility, domestic life, and community, social, & civic life, measured using a CAT version of the Participation Measure for Postacute Care (PM-PAC-CAT) and a 53-item fixed-length survey (PM-PAC-53). RESULTS: The PM-PAC-CAT showed substantial agreement with PM-PAC-53 scores (intraclass correlation coefficient, model 3,1, .71-.81). On average, the PM-PAC-CAT was completed in 42% of the time and with only 48% of the items as compared with the PM-PAC-53. Both formats discriminated across functional severity groups. The PM-PAC-CAT had modest reductions in sensitivity and responsiveness to patient-reported change over a 3-month interval as compared with the PM-PAC-53. CONCLUSIONS: Although continued evaluation is warranted, accurate estimates of participation status and responsiveness to change for group-level analyses can be obtained from CAT administrations, with a sizeable reduction in respondent burden.10a*Activities of Daily Living10a*Adaptation, Physiological10a*Computer Systems10a*Questionnaires10aAdult10aAged10aAged, 80 and over10aChi-Square Distribution10aFactor Analysis, Statistical10aFemale10aHumans10aLongitudinal Studies10aMale10aMiddle Aged10aOutcome Assessment (Health Care)/*methods10aPatient Discharge10aProspective Studies10aRehabilitation/*standards10aSubacute Care/*standards1 aHaley, S M1 aGandek, B1 aSiebens, H1 aBlack-Schaffer, R M1 aSinclair, S J1 aTao, W1 aCoster, W J1 aNi, P1 aJette, A M uhttp://www.iacat.org/content/computerized-adaptive-testing-follow-after-discharge-inpatient-rehabilitation-ii00581nas a2200145 4500008004100000245012000041210006900161300001400230490000700244100001400251700001400265700001900279700001800298856011900316 2008 eng d00aComputerized adaptive testing for patients with knee inpairments produced valid and responsive measures of function0 aComputerized adaptive testing for patients with knee inpairments a1113-11240 v611 aHart, D L1 aWang, Y-C1 aStratford, P W1 aMioduski, J E uhttp://www.iacat.org/content/computerized-adaptive-testing-patients-knee-inpairments-produced-valid-and-responsive01876nas a2200205 4500008003900000245005600039210005600095300001000151490000800161520124900169653002101418653003001439653002501469653001801494653002501512100001301537700001701550700002101567856008201588 2008 d00aComputerized Adaptive Testing of Personality Traits0 aComputerized Adaptive Testing of Personality Traits a12-210 v2163 a

A computerized adaptive testing (CAT) procedure was simulated with ordinal polytomous personality data collected using a
conventional paper-and-pencil testing format. An adapted Dutch version of the dominance scale of Gough and Heilbrun’s Adjective
Check List (ACL) was used. This version contained Likert response scales with five categories. Item parameters were estimated using Samejima’s graded response model from the responses of 1,925 subjects. The CAT procedure was simulated using the responses of 1,517 other subjects. The value of the required standard error in the stopping rule of the CAT was manipulated. The relationship between CAT latent trait estimates and estimates based on all dominance items was studied. Additionally, the pattern of relationships between the CAT latent trait estimates and the other ACL scales was compared to that between latent trait estimates based on the entire item pool and the other ACL scales. The CAT procedure resulted in latent trait estimates qualitatively equivalent to latent trait estimates based on all items, while a substantial reduction of the number of used items could be realized (at the stopping rule of 0.4 about 33% of the 36 items was used).

10aAdaptive Testing10acmoputer-assisted testing10aItem Response Theory10aLikert scales10aPersonality Measures1 aHol, A M1 aVorst, H C M1 aMellenbergh, G J uhttp://www.iacat.org/content/computerized-adaptive-testing-personality-traits00682nas a2200157 4500008004100000245017700041210006900218260003100287100001600318700001200334700001300346700001500359700001400374700001300388856012300401 2008 eng d00aDeveloping a progressive approach to using the GAIN in order to reduce the duration and cost of assessment with the GAIN short screener, Quick and computer adaptive testing0 aDeveloping a progressive approach to using the GAIN in order to  aWashington D.C., USAc20081 aDennis, M L1 aFunk, R1 aTitus, J1 aRiley, B B1 aHosman, S1 aKinne, S uhttp://www.iacat.org/content/developing-progressive-approach-using-gain-order-reduce-duration-and-cost-assessment-gain02560nas a2200313 4500008004100000020004100041245011500082210006900197250001500266300001100281490000700292520149300299653002701792653001001819653001401829653005301843653001501896653001101911653003701922653001801959653003101977653002602008653001402034653003202048100001502080700001002095700001502105856012602120 2008 eng d a0963-8288 (Print)0963-8288 (Linking)00aEfficiency and sensitivity of multidimensional computerized adaptive testing of pediatric physical functioning0 aEfficiency and sensitivity of multidimensional computerized adap a2008/02/26 a479-840 v303 aPURPOSE: Computerized adaptive tests (CATs) have efficiency advantages over fixed-length tests of physical functioning but may lose sensitivity when administering extremely low numbers of items. Multidimensional CATs may efficiently improve sensitivity by capitalizing on correlations between functional domains. Using a series of empirical simulations, we assessed the efficiency and sensitivity of multidimensional CATs compared to a longer fixed-length test. METHOD: Parent responses to the Pediatric Evaluation of Disability Inventory before and after intervention for 239 children at a pediatric rehabilitation hospital provided the data for this retrospective study. Reliability, effect size, and standardized response mean were compared between full-length self-care and mobility subscales and simulated multidimensional CATs with stopping rules at 40, 30, 20, and 10 items. RESULTS: Reliability was lowest in the 10-item CAT condition for the self-care (r = 0.85) and mobility (r = 0.79) subscales; all other conditions had high reliabilities (r > 0.94). All multidimensional CAT conditions had equivalent levels of sensitivity compared to the full set condition for both domains. CONCLUSIONS: Multidimensional CATs efficiently retain the sensitivity of longer fixed-length measures even with 5 items per dimension (10-item CAT condition). Measuring physical functioning with multidimensional CATs could enhance sensitivity following intervention while minimizing response burden.10a*Disability Evaluation10aChild10aComputers10aDisabled Children/*classification/rehabilitation10aEfficiency10aHumans10aOutcome Assessment (Health Care)10aPsychometrics10aReproducibility of Results10aRetrospective Studies10aSelf Care10aSensitivity and Specificity1 aAllen, D D1 aNi, P1 aHaley, S M uhttp://www.iacat.org/content/efficiency-and-sensitivity-multidimensional-computerized-adaptive-testing-pediatric-physical00504nas a2200121 4500008004100000245009900041210006900140300001200209490001100221100001900232700001600251856011500267 2008 eng d00aICAT: An adaptive testing procedure for the identification of idiosyncratic knowledge patterns0 aICAT An adaptive testing procedure for the identification of idi a40–480 v216(1)1 aKingsbury, G G1 aHouser, R L uhttp://www.iacat.org/content/icat-adaptive-testing-procedure-identification-idiosyncratic-knowledge-patterns-002194nas a2200145 4500008004100000245009900041210006900140300001000209490000800219520163900227653003401866100001901900700001601919856011301935 2008 eng d00aICAT: An adaptive testing procedure for the identification of idiosyncratic knowledge patterns0 aICAT An adaptive testing procedure for the identification of idi a40-480 v2163 a

Traditional adaptive tests provide an efficient method for estimating student achievements levels, by adjusting the characteristicsof the test questions to match the performance of each student. These traditional adaptive tests are not designed to identify diosyncraticknowledge patterns. As students move through their education, they learn content in any number of different ways related to their learning style and cognitive development. This may result in a student having different achievement levels from one content area to another within a domain of content. This study investigates whether such idiosyncratic knowledge patterns exist. It discusses the differences between idiosyncratic knowledge patterns and multidimensionality. Finally, it proposes an adaptive testing procedure that can be used to identify a student’s areas of strength and weakness more efficiently than current adaptive testing approaches. The findings of the study indicate that a fairly large number of students may have test results that are influenced by their idiosyncratic knowledge patterns. The findings suggest that these patterns persist across time for a large number of students, and that the differences in student performance between content areas within a subject domain are large enough to allow them to be useful in instruction. Given the existence of idiosyncratic patterns of knowledge, the proposed testing procedure may enable us to provide more useful information to teachers. It should also allow us to differentiate between idiosyncratic patterns or knowledge, and important mutidimensionality in the testing data.

10acomputerized adaptive testing1 aKingsbury, G G1 aHouser, R L uhttp://www.iacat.org/content/icat-adaptive-testing-procedure-identification-idiosyncratic-knowledge-patterns03428nas a2200385 4500008004100000020004100041245010600082210006900188250001500257260001200272300001000284490000700294520220300301653002702504653001502531653001002546653002102556653002402577653002802601653003802629653001102667653001102678653001102689653003902700653000902739653002402748653003102772653004002803100001802843700001502861700001302876700001702889700001402906856012202920 2008 eng d a0271-6798 (Print)0271-6798 (Linking)00aMeasuring physical functioning in children with spinal impairments with computerized adaptive testing0 aMeasuring physical functioning in children with spinal impairmen a2008/03/26 cApr-May a330-50 v283 aBACKGROUND: The purpose of this study was to assess the utility of measuring current physical functioning status of children with scoliosis and kyphosis by applying computerized adaptive testing (CAT) methods. Computerized adaptive testing uses a computer interface to administer the most optimal items based on previous responses, reducing the number of items needed to obtain a scoring estimate. METHODS: This was a prospective study of 77 subjects (0.6-19.8 years) who were seen by a spine surgeon during a routine clinic visit for progress spine deformity. Using a multidimensional version of the Pediatric Evaluation of Disability Inventory CAT program (PEDI-MCAT), we evaluated content range, accuracy and efficiency, known-group validity, concurrent validity with the Pediatric Outcomes Data Collection Instrument, and test-retest reliability in a subsample (n = 16) within a 2-week interval. RESULTS: We found the PEDI-MCAT to have sufficient item coverage in both self-care and mobility content for this sample, although most patients tended to score at the higher ends of both scales. Both the accuracy of PEDI-MCAT scores as compared with a fixed format of the PEDI (r = 0.98 for both mobility and self-care) and test-retest reliability were very high [self-care: intraclass correlation (3,1) = 0.98, mobility: intraclass correlation (3,1) = 0.99]. The PEDI-MCAT took an average of 2.9 minutes for the parents to complete. The PEDI-MCAT detected expected differences between patient groups, and scores on the PEDI-MCAT correlated in expected directions with scores from the Pediatric Outcomes Data Collection Instrument domains. CONCLUSIONS: Use of the PEDI-MCAT to assess the physical functioning status, as perceived by parents of children with complex spinal impairments, seems to be feasible and achieves accurate and efficient estimates of self-care and mobility function. Additional item development will be needed at the higher functioning end of the scale to avoid ceiling effects for older children. LEVEL OF EVIDENCE: This is a level II prospective study designed to establish the utility of computer adaptive testing as an evaluation method in a busy pediatric spine practice.10a*Disability Evaluation10aAdolescent10aChild10aChild, Preschool10aComputer Simulation10aCross-Sectional Studies10aDisabled Children/*rehabilitation10aFemale10aHumans10aInfant10aKyphosis/*diagnosis/rehabilitation10aMale10aProspective Studies10aReproducibility of Results10aScoliosis/*diagnosis/rehabilitation1 aMulcahey, M J1 aHaley, S M1 aDuffy, T1 aPengsheng, N1 aBetz, R R uhttp://www.iacat.org/content/measuring-physical-functioning-children-spinal-impairments-computerized-adaptive-testing00517nas a2200133 4500008004100000020002700041245009500068210006900163250001500232300000600247490000600253100001100259856011300270 2008 eng d a1975-5937 (Electronic)00aPreparing the implementation of computerized adaptive testing for high-stakes examinations0 aPreparing the implementation of computerized adaptive testing fo a2009/02/19 a10 v51 aHuh, S uhttp://www.iacat.org/content/preparing-implementation-computerized-adaptive-testing-high-stakes-examinations00469nas a2200121 4500008004100000245008100041210006900122300001200191490001100203100001600214700001500230856010200245 2008 eng d00aTransitioning from fixed-length questionnaires to computer-adaptive versions0 aTransitioning from fixedlength questionnaires to computeradaptiv a22–280 v216(1)1 aWalter, O B1 aHolling, H uhttp://www.iacat.org/content/transitioning-fixed-length-questionnaires-computer-adaptive-versions01430nas a2200133 4500008003900000245009900039210006900138300000900207490000700216520097800223100002301201700002101224856005101245 2007 d00aAutomated Simultaneous Assembly of Multistage Testlets for a High-Stakes Licensing Examination0 aAutomated Simultaneous Assembly of Multistage Testlets for a Hig a5-200 v673 a

Many challenges exist for high-stakes testing programs offering continuous computerized administration. The automated assembly of test questions to exactly meet content and other requirements, provide uniformity, and control item exposure can be modeled and solved by mixed-integer programming (MIP) methods. A case study of the computerized licensing examination of the American Institute of Certified Public Accountants is offered as one application of MIP techniques for test assembly. The solution illustrates assembly for a computer-adaptive multistage testing design. However, the general form of the constraint-based solution can be modified to generate optimal test designs for paper-based or computerized administrations, regardless of the specific psychometric model. An extension of this methodology allows for long-term planning for the production and use of test content on the basis of an exact psychometric test designs and administration schedules.

1 aBreithaupt, Krista1 aHare, Donovan, R uhttp://epm.sagepub.com/content/67/1/5.abstract01415nas a2200145 4500008003900000245012900039210006900168300001200237490000700249520089000256100002001146700002301166700002701189856005301216 2007 d00aComputerized Adaptive Testing for Polytomous Motivation Items: Administration Mode Effects and a Comparison With Short Forms0 aComputerized Adaptive Testing for Polytomous Motivation Items Ad a412-4290 v313 a

In a randomized experiment (n = 515), a computerized and a computerized adaptive test (CAT) are compared. The item pool consists of 24 polytomous motivation items. Although items are carefully selected, calibration data show that Samejima's graded response model did not fit the data optimally. A simulation study is done to assess possible consequences of model misfit. CAT efficiency was studied by a systematic comparison of the CAT with two types of conventional fixed length short forms, which are created to be good CAT competitors. Results showed no essential administration mode effects. Efficiency analyses show that CAT outperformed the short forms in almost all aspects when results are aggregated along the latent trait scale. The real and the simulated data results are very similar, which indicate that the real data results are not affected by model misfit.

1 aHol, Michiel, A1 aVorst, Harrie, C M1 aMellenbergh, Gideon, J uhttp://apm.sagepub.com/content/31/5/412.abstract01948nas a2200301 4500008004500000020001400045245012900059210006900188300001200257490000700269520093500276653002501211653002101236653002501257653003001282653003001312653001001342653001501352653002601367653002501393653002401418653001501442653001501457100001301472700001701485700002101502856012301523 2007 Engldsh  a0146-621600aComputerized adaptive testing for polytomous motivation items: Administration mode effects and a comparison with short forms0 aComputerized adaptive testing for polytomous motivation items Ad a412-4290 v313 aIn a randomized experiment (n=515), a computerized and a computerized adaptive test (CAT) are compared. The item pool consists of 24 polytomous motivation items. Although items are carefully selected, calibration data show that Samejima's graded response model did not fit the data optimally. A simulation study is done to assess possible consequences of model misfit. CAT efficiency was studied by a systematic comparison of the CAT with two types of conventional fixed length short forms, which are created to be good CAT competitors. Results showed no essential administration mode effects. Efficiency analyses show that CAT outperformed the short forms in almost all aspects when results are aggregated along the latent trait scale. The real and the simulated data results are very similar, which indicate that the real data results are not affected by model misfit. (PsycINFO Database Record (c) 2007 APA ) (journal abstract)10a2220 Tests & Testing10aAdaptive Testing10aAttitude Measurement10acomputer adaptive testing10aComputer Assisted Testing10aitems10aMotivation10apolytomous motivation10aStatistical Validity10aTest Administration10aTest Forms10aTest Items1 aHol, A M1 aVorst, H C M1 aMellenbergh, G J uhttp://www.iacat.org/content/computerized-adaptive-testing-polytomous-motivation-items-administration-mode-effects-and01052nas a2200145 4500008003900000245005000039210005000089300001200139490000700151520063300158100002100791700002200812700001900834856005300853 2007 d00aComputerizing Organizational Attitude Surveys0 aComputerizing Organizational Attitude Surveys a658-6780 v673 a

Two quasi-experimental field studies were conducted to evaluate the psychometric equivalence of computerized and paper-and-pencil job satisfaction measures. The present research extends previous work in the area by providing better control of common threats to validity in quasi-experimental research on test mode effects and by evaluating a more comprehensive measurement model for job attitudes. Results of both studies demonstrated substantial equivalence of the computerized measure with the paper-and-pencil version. Implications for the practical use of computerized organizational attitude surveys are discussed.

1 aMueller, Karsten1 aLiebig, Christian1 aHattrup, Keith uhttp://epm.sagepub.com/content/67/4/658.abstract00495nas a2200109 4500008004100000245006400041210006400105260009700169100001800266700001600284856008500300 2007 eng d00aDesigning templates based on a taxonomy of innovative items0 aDesigning templates based on a taxonomy of innovative items aD. J. Weiss (Ed.). Proceedings of the 2007 GMAC Conference on Computerized Adaptive Testing.1 aParshall, C G1 aHarmes, J C uhttp://www.iacat.org/content/designing-templates-based-taxonomy-innovative-items04076nas a2200133 4500008004100000245009300041210006900134300001200203490000700215520357800222100001503800700001603815856011103831 2007 eng d00aAn exploration and realization of computerized adaptive testing with cognitive diagnosis0 aexploration and realization of computerized adaptive testing wit a747-7530 v393 a An increased attention paid to “cognitive bugs behavior,” appears to lead to an increased research interests in diagnostic testing based on Item Response Theory(IRT)that combines cognitive psychology and psychometrics. The study of cognitive diagnosis were applied mainly to Paper-and-Pencil (P&P) testing. Rarely has it been applied to computerized adaptive testing CAT), To our knowledge, no research on CAT with cognitive diagnosis has been conducted in China. Since CAT is more efficient and accurate than P&P testing, there is important to develop an application technique for cognitive diagnosis suitable for CAT. This study attempts to construct a preliminary CAT system for cognitive diagnosis.With the help of the methods for “ Diagnosis first, Ability estimation second ”, the knowledge state conversion diagram was used to describe all the possible knowledge states in a domain of interest and the relation among the knowledge states at the diagnosis stage, where a new strategy of item selection based-on the algorithm of Depth First Search was proposed. On the other hand, those items that contain attributes which the examinee has not mastered were removed in ability estimation. At the stage of accurate ability estimation, all the items answered by each examinee not only matched his/her ability estimated value, but also were limited to those items whose attributes have been mastered by the examinee.We used Monte Carlo Simulation to simulate all the data of the three different structures of cognitive attributes in this study. These structures were tree-shaped, forest-shaped, and some isolated vertices (that are related to simple Q-matrix). Both tree-shaped and isolated vertices structure were derived from actual cases, while forest-shaped structure was a generalized simulation. 3000 examinees and 3000 items were simulated in the experiment of tree-shaped, 2550 examinees and 3100 items in forest-shaped, and 2000 examinees and 2500 items in isolated vertices. The maximum test length was all assumed as 30 items for all those experiments. The difficulty parameters and the logarithm of the discrimination were drawn from the standard normal distribution N(0,1). There were 100 examinees of each attribute pattern in the experiment of tree-shaped and 50 examinees of each attribute pattern in forest-shaped. In isolated vertices, 2000 examinees are students come from actual case.To assess the behaviors of the proposed diagnostic approach, three assessment indices were used. They are attribute pattern classification agreement rate (abr.APCAR), the Recovery (the average of the absolute deviation between the estimated value and the true value) and the average test length (abr. Length).Parts of results of Monte Carlo study were as follows.For the attribute structure of tree-shaped, APCAR is 84.27%,Recovery is 0.17,Length is 24.80.For the attribute structure of forest-shaped, APCAR is 84.02%,Recovery is 0.172,Length is 23.47.For the attribute structure of isolated vertices, APCAR is 99.16%,Recorvery is 0.256,Length is 27.32.As show the above, we can conclude that the results are favorable. The rate of cognitive diagnosis accuracy has exceeded 80% in each experiment, and the Recovery is also good. Therefore, it should be an acceptable idea to construct an initiatory CAT system for cognitive diagnosis, if we use the methods for “Diagnosis first, Ability estimation second ” with the help of both knowledge state conversion diagram and the new strategy of item selection based-on the algorithm of Depth First Search1 aHaijing, L1 aShuliang, D uhttp://www.iacat.org/content/exploration-and-realization-computerized-adaptive-testing-cognitive-diagnosis00575nas a2200109 4500008004100000245010400041210006900145260009700214100001900311700001600330856011900346 2007 eng d00aICAT: An adaptive testing procedure to allow the identification of idiosyncratic knowledge patterns0 aICAT An adaptive testing procedure to allow the identification o aD. J. Weiss (Ed.). Proceedings of the 2007 GMAC Conference on Computerized Adaptive Testing.1 aKingsbury, G G1 aHouser, R L uhttp://www.iacat.org/content/icat-adaptive-testing-procedure-allow-identification-idiosyncratic-knowledge-patterns03104nas a2200445 4500008004100000020002200041245007100063210006900134250001500203300001200218490000700230520183100237653003802068653001902106653002102125653002002146653001402166653001102180653003002191653001102221653000902232653002502241653004602266653001802312653002602330100001302356700001402369700001702383700001302400700001502413700001502428700001702443700001402460700001802474700002302492700001602515700001602531700001502547856009602562 2007 eng d a0962-9343 (Print)00aIRT health outcomes data analysis project: an overview and summary0 aIRT health outcomes data analysis project an overview and summar a2007/03/14 a121-1320 v163 aBACKGROUND: In June 2004, the National Cancer Institute and the Drug Information Association co-sponsored the conference, "Improving the Measurement of Health Outcomes through the Applications of Item Response Theory (IRT) Modeling: Exploration of Item Banks and Computer-Adaptive Assessment." A component of the conference was presentation of a psychometric and content analysis of a secondary dataset. OBJECTIVES: A thorough psychometric and content analysis was conducted of two primary domains within a cancer health-related quality of life (HRQOL) dataset. RESEARCH DESIGN: HRQOL scales were evaluated using factor analysis for categorical data, IRT modeling, and differential item functioning analyses. In addition, computerized adaptive administration of HRQOL item banks was simulated, and various IRT models were applied and compared. SUBJECTS: The original data were collected as part of the NCI-funded Quality of Life Evaluation in Oncology (Q-Score) Project. A total of 1,714 patients with cancer or HIV/AIDS were recruited from 5 clinical sites. MEASURES: Items from 4 HRQOL instruments were evaluated: Cancer Rehabilitation Evaluation System-Short Form, European Organization for Research and Treatment of Cancer Quality of Life Questionnaire, Functional Assessment of Cancer Therapy and Medical Outcomes Study Short-Form Health Survey. RESULTS AND CONCLUSIONS: Four lessons learned from the project are discussed: the importance of good developmental item banks, the ambiguity of model fit results, the limits of our knowledge regarding the practical implications of model misfit, and the importance in the measurement of HRQOL of construct definition. With respect to these lessons, areas for future research are suggested. The feasibility of developing item banks for broad definitions of health is discussed.10a*Data Interpretation, Statistical10a*Health Status10a*Quality of Life10a*Questionnaires10a*Software10aFemale10aHIV Infections/psychology10aHumans10aMale10aNeoplasms/psychology10aOutcome Assessment (Health Care)/*methods10aPsychometrics10aStress, Psychological1 aCook, KF1 aTeal, C R1 aBjorner, J B1 aCella, D1 aChang, C-H1 aCrane, P K1 aGibbons, L E1 aHays, R D1 aMcHorney, C A1 aOcepek-Welikson, K1 aRaczek, A E1 aTeresi, J A1 aReeve, B B uhttp://www.iacat.org/content/irt-health-outcomes-data-analysis-project-overview-and-summary00375nas a2200109 4500008004100000245005500041210005200096300001000148490001000158100001900168856007800187 2007 eng d00aAn NCME instructional module on multistage testing0 aNCME instructional module on multistage testing a44-520 v26(2)1 aHendrickson, A uhttp://www.iacat.org/content/ncme-instructional-module-multistage-testing00579nas a2200181 4500008004100000245008300041210006900124300001200193490000700205100001000212700001300222700001100235700001000246700001200256700001400268700001300282856010200295 2007 eng d00aProspective evaluation of the am-pac-cat in outpatient rehabilitation settings0 aProspective evaluation of the ampaccat in outpatient rehabilitat a385-3980 v871 aJette1 aHaley, S1 aTao, W1 aNi, P1 aMoed, R1 aMeyers, D1 aZurek, M uhttp://www.iacat.org/content/prospective-evaluation-am-pac-cat-outpatient-rehabilitation-settings02744nas a2200541 4500008004100000020002200041245017000063210006900233250001500302260000800317300001100325490000700336520116200343653001901505653002501524653002101549653002101570653001501591653001001606653000901616653001601625653002301641653003201664653001101696653001101707653000901718653001601727653004601743653001801789653002901807653001801836100001501854700001401869700001701883700001301900700001501913700001601928700001501944700001701959700001401976700001801990700001102008700001602019700001502035700001302050700001302063856012602076 2007 eng d a0025-7079 (Print)00aPsychometric evaluation and calibration of health-related quality of life item banks: plans for the Patient-Reported Outcomes Measurement Information System (PROMIS)0 aPsychometric evaluation and calibration of healthrelated quality a2007/04/20 cMay aS22-310 v453 aBACKGROUND: The construction and evaluation of item banks to measure unidimensional constructs of health-related quality of life (HRQOL) is a fundamental objective of the Patient-Reported Outcomes Measurement Information System (PROMIS) project. OBJECTIVES: Item banks will be used as the foundation for developing short-form instruments and enabling computerized adaptive testing. The PROMIS Steering Committee selected 5 HRQOL domains for initial focus: physical functioning, fatigue, pain, emotional distress, and social role participation. This report provides an overview of the methods used in the PROMIS item analyses and proposed calibration of item banks. ANALYSES: Analyses include evaluation of data quality (eg, logic and range checking, spread of response distribution within an item), descriptive statistics (eg, frequencies, means), item response theory model assumptions (unidimensionality, local independence, monotonicity), model fit, differential item functioning, and item calibration for banking. RECOMMENDATIONS: Summarized are key analytic issues; recommendations are provided for future evaluations of item banks in HRQOL assessment.10a*Health Status10a*Information Systems10a*Quality of Life10a*Self Disclosure10aAdolescent10aAdult10aAged10aCalibration10aDatabases as Topic10aEvaluation Studies as Topic10aFemale10aHumans10aMale10aMiddle Aged10aOutcome Assessment (Health Care)/*methods10aPsychometrics10aQuestionnaires/standards10aUnited States1 aReeve, B B1 aHays, R D1 aBjorner, J B1 aCook, KF1 aCrane, P K1 aTeresi, J A1 aThissen, D1 aRevicki, D A1 aWeiss, DJ1 aHambleton, RK1 aLiu, H1 aGershon, RC1 aReise, S P1 aLai, J S1 aCella, D uhttp://www.iacat.org/content/psychometric-evaluation-and-calibration-health-related-quality-life-item-banks-plans-patient02412nas a2200289 4500008004100000020002200041245010800063210006900171260004500240300001000285490000700295520141000302653003201712653002501744653002501769653002501794653002601819653001801845653003701863653002101900653001301921100001501934700001401949700001901963700002001982856012002002 2007 eng d a1015-5759 (Print)00aPsychometric properties of an emotional adjustment measure: An application of the graded response model0 aPsychometric properties of an emotional adjustment measure An ap bHogrefe & Huber Publishers GmbH: Germany a39-460 v233 aItem response theory (IRT) provides valuable methods for the analysis of the psychometric properties of a psychological measure. However, IRT has been mainly used for assessing achievements and ability rather than personality factors. This paper presents an application of the IRT to a personality measure. Thus, the psychometric properties of a new emotional adjustment measure that consists of a 28-six graded response items is shown. Classical test theory (CTT) analyses as well as IRT analyses are carried out. Samejima's (1969) graded-response model has been used for estimating item parameters. Results show that the bank of items fulfills model assumptions and fits the data reasonably well, demonstrating the suitability of the IRT models for the description and use of data originating from personality measures. In this sense, the model fulfills the expectations that IRT has undoubted advantages: (1) The invariance of the estimated parameters, (2) the treatment given to the standard error of measurement, and (3) the possibilities offered for the construction of computerized adaptive tests (CAT). The bank of items shows good reliability. It also shows convergent validity compared to the Eysenck Personality Inventory (EPQ-A; Eysenck & Eysenck, 1975) and the Big Five Questionnaire (BFQ; Caprara, Barbaranelli, & Borgogni, 1993). (PsycINFO Database Record (c) 2007 APA, all rights reserved)10acomputerized adaptive tests10aEmotional Adjustment10aItem Response Theory10aPersonality Measures10apersonnel recruitment10aPsychometrics10aSamejima's graded response model10atest reliability10avalidity1 aRubio, V J1 aAguado, D1 aHontangas, P M1 aHernández, J M uhttp://www.iacat.org/content/psychometric-properties-emotional-adjustment-measure-application-graded-response-model02176nas a2200181 4500008004100000020002200041245006200063210006200125260003800187300001200225490000700237520155900244653002901803653003401832653001801866100002201884856008801906 2006 eng d a0033-3018 (Print)00aAdaptive success control in computerized adaptive testing0 aAdaptive success control in computerized adaptive testing bPabst Science Publishers: Germany a436-4500 v483 aIn computerized adaptive testing (CAT) procedures within the framework of probabilistic test theory the difficulty of an item is adjusted to the ability of the respondent, with the aim of maximizing the amount of information generated per item, thereby also increasing test economy and test reasonableness. However, earlier research indicates that respondents might feel over-challenged by a constant success probability of p = 0.5 and therefore cannot come to a sufficiently high answer certainty within a reasonable timeframe. Consequently response time per item increases, which -- depending on the test material -- can outweigh the benefit of administering optimally informative items. Instead of a benefit, the result of using CAT procedures could be a loss of test economy. Based on this problem, an adaptive success control algorithm was designed and tested, adapting the success probability to the working style of the respondent. Persons who need higher answer certainty in order to come to a decision are detected and receive a higher success probability, in order to minimize the test duration (not the number of items as in classical CAT). The method is validated on the re-analysis of data from the Adaptive Matrices Test (AMT, Hornke, Etzel & Rettig, 1999) and by the comparison between an AMT version using classical CAT and an experimental version using Adaptive Success Control. The results are discussed in the light of psychometric and psychological aspects of test quality. (PsycINFO Database Record (c) 2007 APA, all rights reserved)10aadaptive success control10acomputerized adaptive testing10aPsychometrics1 aHäusler, Joachim uhttp://www.iacat.org/content/adaptive-success-control-computerized-adaptive-testing00347nas a2200097 4500008004100000245004000041210003800081260005500119100001300174856006200187 2006 eng d00aA CAT with personality and attitude0 aCAT with personality and attitude aEnschede, The Netherlands: PrintPartners Ipskamp B1 aHol, A M uhttp://www.iacat.org/content/cat-personality-and-attitude02403nas a2200241 4500008004100000020002200041245008500063210006900148260002500217300001200242490000700254520161500261653000801876653003401884653002601918653003001944653002601974100001402000700001402014700001602028700001502044856010202059 2006 eng d a0439-755X (Print)00aThe comparison among item selection strategies of CAT with multiple-choice items0 acomparison among item selection strategies of CAT with multiplec bScience Press: China a778-7830 v383 aThe initial purpose of comparing item selection strategies for CAT was to increase the efficiency of tests. As studies continued, however, it was found that increasing the efficiency of item bank using was also an important goal of comparing item selection strategies. These two goals often conflicted. The key solution was to find a strategy with which both goals could be accomplished. The item selection strategies for graded response model in this study included: the average of the difficulty orders matching with the ability; the medium of the difficulty orders matching with the ability; maximum information; A stratified (average); and A stratified (medium). The evaluation indexes used for comparison included: the bias of ability estimates for the true; the standard error of ability estimates; the average items which the examinees have administered; the standard deviation of the frequency of items selected; and sum of the indices weighted. Using the Monte Carlo simulation method, we obtained some data and computer iterated the data 20 times each under the conditions that the item difficulty parameters followed the normal distribution and even distribution. The results were as follows; The results indicated that no matter difficulty parameters followed the normal distribution or even distribution. Every type of item selection strategies designed in this research had its strong and weak points. In general evaluation, under the condition that items were stratified appropriately, A stratified (medium) (ASM) had the best effect. (PsycINFO Database Record (c) 2007 APA, all rights reserved)10aCAT10acomputerized adaptive testing10agraded response model10aitem selection strategies10amultiple choice items1 aHai-qi, D1 aDe-zhi, C1 aShuliang, D1 aTaiping, D uhttp://www.iacat.org/content/comparison-among-item-selection-strategies-cat-multiple-choice-items00526nas a2200133 4500008003900000245013200039210006900171300001200240490000700252100002300259700001900282700002500301856006600326 2006 d00aComparison of the Psychometric Properties of Several Computer-Based Test Designs for Credentialing Exams With Multiple Purposes0 aComparison of the Psychometric Properties of Several ComputerBas a203-2200 v191 aJodoin, Michael, G1 aZenisky, April1 aHambleton, Ronald, K uhttp://www.tandfonline.com/doi/abs/10.1207/s15324818ame1903_302652nas a2200397 4500008004100000020002200041245013500063210006900198250001500267260000800282300001200290490000700302520140700309653002601716653003101742653001501773653001001788653000901798653002201807653002501829653003301854653001101887653001101898653000901909653001601918653004601934653003001980653003102010653001302041100001502054700001002069700001802079700001602097700001502113856012602128 2006 eng d a0895-4356 (Print)00aComputer adaptive testing improved accuracy and precision of scores over random item selection in a physical functioning item bank0 aComputer adaptive testing improved accuracy and precision of sco a2006/10/10 cNov a1174-820 v593 aBACKGROUND AND OBJECTIVE: Measuring physical functioning (PF) within and across postacute settings is critical for monitoring outcomes of rehabilitation; however, most current instruments lack sufficient breadth and feasibility for widespread use. Computer adaptive testing (CAT), in which item selection is tailored to the individual patient, holds promise for reducing response burden, yet maintaining measurement precision. We calibrated a PF item bank via item response theory (IRT), administered items with a post hoc CAT design, and determined whether CAT would improve accuracy and precision of score estimates over random item selection. METHODS: 1,041 adults were interviewed during postacute care rehabilitation episodes in either hospital or community settings. Responses for 124 PF items were calibrated using IRT methods to create a PF item bank. We examined the accuracy and precision of CAT-based scores compared to a random selection of items. RESULTS: CAT-based scores had higher correlations with the IRT-criterion scores, especially with short tests, and resulted in narrower confidence intervals than scores based on a random selection of items; gains, as expected, were especially large for low and high performing adults. CONCLUSION: The CAT design may have important precision and efficiency advantages for point-of-care functional assessment in rehabilitation practice settings.10a*Recovery of Function10aActivities of Daily Living10aAdolescent10aAdult10aAged10aAged, 80 and over10aConfidence Intervals10aFactor Analysis, Statistical10aFemale10aHumans10aMale10aMiddle Aged10aOutcome Assessment (Health Care)/*methods10aRehabilitation/*standards10aReproducibility of Results10aSoftware1 aHaley, S M1 aNi, P1 aHambleton, RK1 aSlavin, M D1 aJette, A M uhttp://www.iacat.org/content/computer-adaptive-testing-improved-accuracy-and-precision-scores-over-random-item-selectio-000642nas a2200169 4500008004100000020001300041245013500054210006900189300001400258490000700272100001300279700001000292700001800302700001400320700001300334856012500347 2006 eng d a0895435600aComputer adaptive testing improved accuracy and precision of scores over random item selection in a physical functioning item bank0 aComputer adaptive testing improved accuracy and precision of sco a1174-11820 v591 aHaley, S1 aNi, P1 aHambleton, RK1 aSlavin, M1 aJette, A uhttp://www.iacat.org/content/computer-adaptive-testing-improved-accuracy-and-precision-scores-over-random-item-selection03329nas a2200469 4500008004100000020002200041245011600063210006900179250001500248260000800263300001200271490000700283520189400290653003202184653003102216653002202247653002002269653001002289653000902299653002202308653002802330653003302358653001102391653001102402653002502413653000902438653001602447653004602463653002202509653002402531653003002555653002902585100001502614700001502629700001602644700001102660700002402671700001402695700001802709700001002727856012202737 2006 eng d a0003-9993 (Print)00aComputerized adaptive testing for follow-up after discharge from inpatient rehabilitation: I. Activity outcomes0 aComputerized adaptive testing for followup after discharge from  a2006/08/01 cAug a1033-420 v873 aOBJECTIVE: To examine score agreement, precision, validity, efficiency, and responsiveness of a computerized adaptive testing (CAT) version of the Activity Measure for Post-Acute Care (AM-PAC-CAT) in a prospective, 3-month follow-up sample of inpatient rehabilitation patients recently discharged home. DESIGN: Longitudinal, prospective 1-group cohort study of patients followed approximately 2 weeks after hospital discharge and then 3 months after the initial home visit. SETTING: Follow-up visits conducted in patients' home setting. PARTICIPANTS: Ninety-four adults who were recently discharged from inpatient rehabilitation, with diagnoses of neurologic, orthopedic, and medically complex conditions. INTERVENTIONS: Not applicable. MAIN OUTCOME MEASURES: Summary scores from AM-PAC-CAT, including 3 activity domains of movement and physical, personal care and instrumental, and applied cognition were compared with scores from a traditional fixed-length version of the AM-PAC with 66 items (AM-PAC-66). RESULTS: AM-PAC-CAT scores were in good agreement (intraclass correlation coefficient model 3,1 range, .77-.86) with scores from the AM-PAC-66. On average, the CAT programs required 43% of the time and 33% of the items compared with the AM-PAC-66. Both formats discriminated across functional severity groups. The standardized response mean (SRM) was greater for the movement and physical fixed form than the CAT; the effect size and SRM of the 2 other AM-PAC domains showed similar sensitivity between CAT and fixed formats. Using patients' own report as an anchor-based measure of change, the CAT and fixed length formats were comparable in responsiveness to patient-reported change over a 3-month interval. CONCLUSIONS: Accurate estimates for functional activity group-level changes can be obtained from CAT administrations, with a considerable reduction in administration time.10a*Activities of Daily Living10a*Adaptation, Physiological10a*Computer Systems10a*Questionnaires10aAdult10aAged10aAged, 80 and over10aChi-Square Distribution10aFactor Analysis, Statistical10aFemale10aHumans10aLongitudinal Studies10aMale10aMiddle Aged10aOutcome Assessment (Health Care)/*methods10aPatient Discharge10aProspective Studies10aRehabilitation/*standards10aSubacute Care/*standards1 aHaley, S M1 aSiebens, H1 aCoster, W J1 aTao, W1 aBlack-Schaffer, R M1 aGandek, B1 aSinclair, S J1 aNi, P uhttp://www.iacat.org/content/computerized-adaptive-testing-follow-after-discharge-inpatient-rehabilitation-i-activity02398nas a2200301 4500008004100000020002200041245010800063210006900171260002400240300000900264490000600273520142200279653002201701653003401723653002301757653003201780653001801812653002101830653001801851100001401869700001301883700001401896700001901910700001501929700001701944700001301961856012201974 2006 eng d a1529-7713 (Print)00aExpansion of a physical function item bank and development of an abbreviated form for clinical research0 aExpansion of a physical function item bank and development of an bRichard M Smith: US a1-150 v73 aWe expanded an existing 33-item physical function (PF) item bank with a sufficient number of items to enable computerized adaptive testing (CAT). Ten items were written to expand the bank and the new item pool was administered to 295 people with cancer. For this analysis of the new pool, seven poorly performing items were identified for further examination. This resulted in a bank with items that define an essentially unidimensional PF construct, cover a wide range of that construct, reliably measure the PF of persons with cancer, and distinguish differences in self-reported functional performance levels. We also developed a 5-item (static) assessment form ("BriefPF") that can be used in clinical research to express scores on the same metric as the overall bank. The BriefPF was compared to the PF-10 from the Medical Outcomes Study SF-36. Both short forms significantly differentiated persons across functional performance levels. While the entire bank was more precise across the PF continuum than either short form, there were differences in the area of the continuum in which each short form was more precise: the BriefPF was more precise than the PF-10 at the lower functional levels and the PF-10 was more precise than the BriefPF at the higher levels. Future research on this bank will include the development of a CAT version, the PF-CAT. (PsycINFO Database Record (c) 2007 APA, all rights reserved)10aclinical research10acomputerized adaptive testing10aperformance levels10aphysical function item bank10aPsychometrics10atest reliability10aTest Validity1 aBode, R K1 aLai, J-S1 aDineen, K1 aHeinemann, A W1 aShevrin, D1 aVon Roenn, J1 aCella, D uhttp://www.iacat.org/content/expansion-physical-function-item-bank-and-development-abbreviated-form-clinical-research02186nas a2200181 4500008004100000245009900041210006900140260000800209300001400217490000700231520157400238100001401812700001301826700001401839700001601853700001301869856012201882 2006 eng d00aItem banks and their potential applications to health status assessment in diverse populations0 aItem banks and their potential applications to health status ass cNov aS189-S1970 v443 aIn the context of an ethnically diverse, aging society, attention is increasingly turning to health-related quality of life measurement to evaluate healthcare and treatment options for chronic diseases. When evaluating and treating symptoms and concerns such as fatigue, pain, or physical function, reliable and accurate assessment is a priority. Modern psychometric methods have enabled us to move from long, static tests that provide inefficient and often inaccurate assessment of individual patients, to computerized adaptive tests (CATs) that can precisely measure individuals on health domains of interest. These modern methods, collectively referred to as item response theory (IRT), can produce calibrated "item banks" from larger pools of questions. From these banks, CATs can be conducted on individuals to produce their scores on selected domains. Item banks allow for comparison of patients across different question sets because the patient's score is expressed on a common scale. Other advantages of using item banks include flexibility in terms of the degree of precision desired; interval measurement properties under most circumstances; realistic capability for accurate individual assessment over time (using CAT); and measurement equivalence across different patient populations. This work summarizes the process used in the creation and evaluation of item banks and reviews their potential contributions and limitations regarding outcome assessment and patient care, particularly when they are applied across people of different cultural backgrounds.1 aHahn, E A1 aCella, D1 aBode, R K1 aGershon, RC1 aLai, J S uhttp://www.iacat.org/content/item-banks-and-their-potential-applications-health-status-assessment-diverse-populations03383nas a2200205 4500008004100000020002200041245009700063210006900160260002500229300001200254490000700266520266000273653003402933653002802967100001502995700001903010700001703029700001403046856011703060 2006 eng d a0439-755X (Print)00a[Item Selection Strategies of Computerized Adaptive Testing based on Graded Response Model.]0 aItem Selection Strategies of Computerized Adaptive Testing based bScience Press: China a461-4670 v383 aItem selection strategy (ISS) is an important component of Computerized Adaptive Testing (CAT). Its performance directly affects the security, efficiency and precision of the test. Thus, ISS becomes one of the central issues in CATs based on the Graded Response Model (GRM). It is well known that the goal of IIS is to administer the next unused item remaining in the item bank that best fits the examinees current ability estimate. In dichotomous IRT models, every item has only one difficulty parameter and the item whose difficulty matches the examinee's current ability estimate is considered to be the best fitting item. However, in GRM, each item has more than two ordered categories and has no single value to represent the item difficulty. Consequently, some researchers have used to employ the average or the median difficulty value across categories as the difficulty estimate for the item. Using the average value and the median value in effect introduced two corresponding ISSs. In this study, we used computer simulation compare four ISSs based on GRM. We also discussed the effect of "shadow pool" on the uniformity of pool usage as well as the influence of different item parameter distributions and different ability estimation methods on the evaluation criteria of CAT. In the simulation process, Monte Carlo method was adopted to simulate the entire CAT process; 1,000 examinees drawn from standard normal distribution and four 1,000-sized item pools of different item parameter distributions were also simulated. The assumption of the simulation is that a polytomous item is comprised of six ordered categories. In addition, ability estimates were derived using two methods. They were expected a posteriori Bayesian (EAP) and maximum likelihood estimation (MLE). In MLE, the Newton-Raphson iteration method and the Fisher Score iteration method were employed, respectively, to solve the likelihood equation. Moreover, the CAT process was simulated with each examinee 30 times to eliminate random error. The IISs were evaluated by four indices usually used in CAT from four aspects--the accuracy of ability estimation, the stability of IIS, the usage of item pool, and the test efficiency. Simulation results showed adequate evaluation of the ISS that matched the estimate of an examinee's current trait level with the difficulty values across categories. Setting "shadow pool" in ISS was able to improve the uniformity of pool utilization. Finally, different distributions of the item parameter and different ability estimation methods affected the evaluation indices of CAT. (PsycINFO Database Record (c) 2007 APA, all rights reserved)10acomputerized adaptive testing10aitem selection strategy1 aPing, Chen1 aShuliang, Ding1 aHaijing, Lin1 aJie, Zhou uhttp://www.iacat.org/content/item-selection-strategies-computerized-adaptive-testing-based-graded-response-model02567nas a2200349 4500008004100000020002200041245016600063210006900229250001500298260000800313300001100321490000700332520142900339653002701768653001601795653001501811653001001826653002101836653001401857653005201871653001501923653001101938653001101949653003701960653001801997653001402015100001502029700001002044700001602054700002502070856012202095 2006 eng d a0003-9993 (Print)00aMeasurement precision and efficiency of multidimensional computer adaptive testing of physical functioning using the pediatric evaluation of disability inventory0 aMeasurement precision and efficiency of multidimensional compute a2006/08/29 cSep a1223-90 v873 aOBJECTIVE: To compare the measurement efficiency and precision of a multidimensional computer adaptive testing (M-CAT) application to a unidimensional CAT (U-CAT) comparison using item bank data from 2 of the functional skills scales of the Pediatric Evaluation of Disability Inventory (PEDI). DESIGN: Using existing PEDI mobility and self-care item banks, we compared the stability of item calibrations and model fit between unidimensional and multidimensional Rasch models and compared the efficiency and precision of the U-CAT- and M-CAT-simulated assessments to a random draw of items. SETTING: Pediatric rehabilitation hospital and clinics. PARTICIPANTS: Clinical and normative samples. INTERVENTIONS: Not applicable. MAIN OUTCOME MEASURES: Not applicable. RESULTS: The M-CAT had greater levels of precision and efficiency than the separate mobility and self-care U-CAT versions when using a similar number of items for each PEDI subdomain. Equivalent estimation of mobility and self-care scores can be achieved with a 25% to 40% item reduction with the M-CAT compared with the U-CAT. CONCLUSIONS: M-CAT applications appear to have both precision and efficiency advantages compared with separate U-CAT assessments when content subdomains have a high correlation. Practitioners may also realize interpretive advantages of reporting test score information for each subdomain when separate clinical inferences are desired.10a*Disability Evaluation10a*Pediatrics10aAdolescent10aChild10aChild, Preschool10aComputers10aDisabled Persons/*classification/rehabilitation10aEfficiency10aHumans10aInfant10aOutcome Assessment (Health Care)10aPsychometrics10aSelf Care1 aHaley, S M1 aNi, P1 aLudlow, L H1 aFragala-Pinkham, M A uhttp://www.iacat.org/content/measurement-precision-and-efficiency-multidimensional-computer-adaptive-testing-physical02433nas a2200241 4500008004100000020004600041245008600087210006900173260002500242300001200267490000700279520159900286653001801885653002401903653002001927653002801947653002101975653004001996653001402036100001802050700001202068856011102080 2006 eng d a0895-7347 (Print); 1532-4818 (Electronic)00aOptimal and nonoptimal computer-based test designs for making pass-fail decisions0 aOptimal and nonoptimal computerbased test designs for making pas bLawrence Erlbaum: US a221-2390 v193 aNow that many credentialing exams are being routinely administered by computer, new computer-based test designs, along with item response theory models, are being aggressively researched to identify specific designs that can increase the decision consistency and accuracy of pass-fail decisions. The purpose of this study was to investigate the impact of optimal and nonoptimal multistage test (MST) designs, linear parallel-form test designs (LPFT), and computer adaptive test (CAT) designs on the decision consistency and accuracy of pass-fail decisions. Realistic testing situations matching those of one of the large credentialing agencies were simulated to increase the generalizability of the findings. The conclusions were clear: (a) With the LPFTs, matching test information functions (TIFs) to the mean of the proficiency distribution produced slightly better results than matching them to the passing score; (b) all of the test designs worked better than test construction using random selection of items, subject to content constraints only; (c) CAT performed better than the other test designs; and (d) if matching a TIP to the passing score, the MST design produced a bit better results than the LPFT design. If an argument for the MST design is to be made, it can be made on the basis of slight improvements over the LPFT design and better expected item bank utilization, candidate preference, and the potential for improved diagnostic feedback, compared with the feedback that is possible with fixed linear test forms. (PsycINFO Database Record (c) 2007 APA, all rights reserved)10aadaptive test10acredentialing exams10aDecision Making10aEducational Measurement10amultistage tests10aoptimal computer-based test designs10atest form1 aHambleton, RK1 aXing, D uhttp://www.iacat.org/content/optimal-and-nonoptimal-computer-based-test-designs-making-pass-fail-decisions00578nas a2200133 4500008003900000245014600039210006900185300001200254490000700266100001500273700002500288700001000313856012100323 2006 d00aSensitivity of a computer adaptive assessment for measuring functional mobility changes in children enrolled in a community fitness programme0 aSensitivity of a computer adaptive assessment for measuring func a616-6220 v201 aHaley, S M1 aFragala-Pinkham, M A1 aNi, P uhttp://www.iacat.org/content/sensitivity-computer-adaptive-assessment-measuring-functional-mobility-changes-children00595nas a2200145 4500008004100000245013800041210006900179300001200248490000700260100001200267700001600279700001500295700001700310856012200327 2006 eng d00aSimulated computerized adaptive test for patients with lumbar spine impairments was efficient and produced valid measures of function0 aSimulated computerized adaptive test for patients with lumbar sp a947-9560 v591 aHart, D1 aMioduski, J1 aWerenke, M1 aStratford, P uhttp://www.iacat.org/content/simulated-computerized-adaptive-test-patients-lumbar-spine-impairments-was-efficient-and02111nas a2200229 4500008004100000245013800041210006900179300001400248490000700262520127000269653003101539653003401570653002501604653001701629653001901646653002401665100001401689700001801703700001701721700001901738856012401757 2006 eng d00aSimulated computerized adaptive test for patients with lumbar spine impairments was efficient and produced valid measures of function0 aSimulated computerized adaptive test for patients with lumbar sp a947–9560 v593 aObjective: To equate physical functioning (PF) items with Back Pain Functional Scale (BPFS) items, develop a computerized adaptive test (CAT) designed to assess lumbar spine functional status (LFS) in people with lumbar spine impairments, and compare discriminant validity of LFS measures (qIRT) generated using all items analyzed with a rating scale Item Response Theory model (RSM) and measures generated using the simulated CAT (qCAT). Methods: We performed a secondary analysis of retrospective intake rehabilitation data. Results: Unidimensionality and local independence of 25 BPFS and PF items were supported. Differential item functioning was negligible for levels of symptom acuity, gender, age, and surgical history. The RSM fit the data well. A lumbar spine specific CAT was developed that was 72% more efficient than using all 25 items to estimate LFS measures. qIRT and qCAT measures did not discriminate patients by symptom acuity, age, or gender, but discriminated patients by surgical history in similar clinically logical ways. qCAT measures were as precise as qIRT measures. Conclusion: A body part specific simulated CAT developed from an LFS item bank was efficient and produced precise measures of LFS without eroding discriminant validity.10aBack Pain Functional Scale10acomputerized adaptive testing10aItem Response Theory10aLumbar spine10aRehabilitation10aTrue-score equating1 aHart, D L1 aMioduski, J E1 aWerneke, M W1 aStratford, P W uhttp://www.iacat.org/content/simulated-computerized-adaptive-test-patients-lumbar-spine-impairments-was-efficient-and-002653nas a2200409 4500008004100000245013400041210006900175300001000244490000700254520123100261653002501492653003201517653003101549653001001580653000901590653002201599653003301621653001101654653001101665653000901676653001601685653002401701653003101725653004101756653004501797653006801842653006101910653003001971653002802001653002202029100001402051700001302065700001802078700001402096700001502110856011802125 2006 eng d00aSimulated computerized adaptive test for patients with shoulder impairments was efficient and produced valid measures of function0 aSimulated computerized adaptive test for patients with shoulder  a290-80 v593 aBACKGROUND AND OBJECTIVE: To test unidimensionality and local independence of a set of shoulder functional status (SFS) items, develop a computerized adaptive test (CAT) of the items using a rating scale item response theory model (RSM), and compare discriminant validity of measures generated using all items (theta(IRT)) and measures generated using the simulated CAT (theta(CAT)). STUDY DESIGN AND SETTING: We performed a secondary analysis of data collected prospectively during rehabilitation of 400 patients with shoulder impairments who completed 60 SFS items. RESULTS: Factor analytic techniques supported that the 42 SFS items formed a unidimensional scale and were locally independent. Except for five items, which were deleted, the RSM fit the data well. The remaining 37 SFS items were used to generate the CAT. On average, 6 items were needed to estimate precise measures of function using the SFS CAT, compared with all 37 SFS items. The theta(IRT) and theta(CAT) measures were highly correlated (r = .96) and resulted in similar classifications of patients. CONCLUSION: The simulated SFS CAT was efficient and produced precise, clinically relevant measures of functional status with good discriminating ability.10a*Computer Simulation10a*Range of Motion, Articular10aActivities of Daily Living10aAdult10aAged10aAged, 80 and over10aFactor Analysis, Statistical10aFemale10aHumans10aMale10aMiddle Aged10aProspective Studies10aReproducibility of Results10aResearch Support, N.I.H., Extramural10aResearch Support, U.S. Gov't, Non-P.H.S.10aShoulder Dislocation/*physiopathology/psychology/rehabilitation10aShoulder Pain/*physiopathology/psychology/rehabilitation10aShoulder/*physiopathology10aSickness Impact Profile10aTreatment Outcome1 aHart, D L1 aCook, KF1 aMioduski, J E1 aTeal, C R1 aCrane, P K uhttp://www.iacat.org/content/simulated-computerized-adaptive-test-patients-shoulder-impairments-was-efficient-and02072nas a2200217 4500008004500000245013400045210006900179300001200248490000700260520127300267653003401540653004201574653002501616653001901641100001401660700001301674700001801687700001401705700001501719856012001734 2006 Engldsh 00aSimulated computerized adaptive test for patients with shoulder impairments was efficient and produced valid measures of function0 aSimulated computerized adaptive test for patients with shoulder  a290-2980 v593 a

Background and Objective: To test unidimensionality and local independence of a set of shoulder functional status (SFS) items,
develop a computerized adaptive test (CAT) of the items using a rating scale item response theory model (RSM), and compare discriminant validity of measures generated using all items (qIRT) and measures generated using the simulated CAT (qCAT).
Study Design and Setting: We performed a secondary analysis of data collected prospectively during rehabilitation of 400 patients
with shoulder impairments who completed 60 SFS items.
Results: Factor analytic techniques supported that the 42 SFS items formed a unidimensional scale and were locally independent. Except for five items, which were deleted, the RSM fit the data well. The remaining 37 SFS items were used to generate the CAT. On average, 6 items on were needed to estimate precise measures of function using the SFS CAT, compared with all 37 SFS items. The qIRT and qCAT measures were highly correlated (r 5 .96) and resulted in similar classifications of patients.
Conclusion: The simulated SFS CAT was efficient and produced precise, clinically relevant measures of functional status with good
discriminating ability. 

10acomputerized adaptive testing10aFlexilevel Scale of Shoulder Function10aItem Response Theory10aRehabilitation1 aHart, D L1 aCook, KF1 aMioduski, J E1 aTeal, C R1 aCrane, P K uhttp://www.iacat.org/content/simulated-computerized-adaptive-test-patients-shoulder-impairments-was-efficient-and-001469nas a2200217 4500008004100000245015400041210006900195260004600264300001200310520063100322653003000953653001100983653002500994653001601019653002201035653002301057100001801080700001501098700001401113856012401127 2005 eng d00aApplications of item response theory to improve health outcomes assessment: Developing item banks, linking instruments, and computer-adaptive testing0 aApplications of item response theory to improve health outcomes  aCambridge, UKbCambridge University Press a445-4643 a(From the chapter) The current chapter builds on Reise's introduction to the basic concepts, assumptions, popular models, and important features of IRT and discusses the applications of item response theory (IRT) modeling to health outcomes assessment. In particular, we highlight the critical role of IRT modeling in: developing an instrument to match a study's population; linking two or more instruments measuring similar constructs on a common metric; and creating item banks that provide the foundation for tailored short-form instruments or for computerized adaptive assessments. (PsycINFO Database Record (c) 2005 APA )10aComputer Assisted Testing10aHealth10aItem Response Theory10aMeasurement10aTest Construction10aTreatment Outcomes1 aHambleton, RK1 aGotay, C C1 aSnyder, C uhttp://www.iacat.org/content/applications-item-response-theory-improve-health-outcomes-assessment-developing-item-banks03123nas a2200385 4500008004100000020002200041245012900063210006900192250001500261260000800276300001000284490000700294520188400301653002502185653002702210653001502237653001002252653002102262653002802283653003802311653001102349653001102360653001102371653000902382653004602391653002702437653003002464653003202494100001502526700001602541700001602557700001502573700002502588856012402613 2005 eng d a0003-9993 (Print)00aAssessing mobility in children using a computer adaptive testing version of the pediatric evaluation of disability inventory0 aAssessing mobility in children using a computer adaptive testing a2005/05/17 cMay a932-90 v863 aOBJECTIVE: To assess score agreement, validity, precision, and response burden of a prototype computerized adaptive testing (CAT) version of the Mobility Functional Skills Scale (Mob-CAT) of the Pediatric Evaluation of Disability Inventory (PEDI) as compared with the full 59-item version (Mob-59). DESIGN: Computer simulation analysis of cross-sectional and longitudinal retrospective data; and cross-sectional prospective study. SETTING: Pediatric rehabilitation hospital, including inpatient acute rehabilitation, day school program, outpatient clinics, community-based day care, preschool, and children's homes. PARTICIPANTS: Four hundred sixty-nine children with disabilities and 412 children with no disabilities (analytic sample); 41 children without disabilities and 39 with disabilities (cross-validation sample). INTERVENTIONS: Not applicable. MAIN OUTCOME MEASURES: Summary scores from a prototype Mob-CAT application and versions using 15-, 10-, and 5-item stopping rules; scores from the Mob-59; and number of items and time (in seconds) to administer assessments. RESULTS: Mob-CAT scores from both computer simulations (intraclass correlation coefficient [ICC] range, .94-.99) and field administrations (ICC=.98) were in high agreement with scores from the Mob-59. Using computer simulations of retrospective data, discriminant validity, and sensitivity to change of the Mob-CAT closely approximated that of the Mob-59, especially when using the 15- and 10-item stopping rule versions of the Mob-CAT. The Mob-CAT used no more than 15% of the items for any single administration, and required 20% of the time needed to administer the Mob-59. CONCLUSIONS: Comparable score estimates for the PEDI mobility scale can be obtained from CAT administrations, with losses in validity and precision for shorter forms, but with a considerable reduction in administration time.10a*Computer Simulation10a*Disability Evaluation10aAdolescent10aChild10aChild, Preschool10aCross-Sectional Studies10aDisabled Children/*rehabilitation10aFemale10aHumans10aInfant10aMale10aOutcome Assessment (Health Care)/*methods10aRehabilitation Centers10aRehabilitation/*standards10aSensitivity and Specificity1 aHaley, S M1 aRaczek, A E1 aCoster, W J1 aDumas, H M1 aFragala-Pinkham, M A uhttp://www.iacat.org/content/assessing-mobility-children-using-computer-adaptive-testing-version-pediatric-evaluation-000639nas a2200169 4500008004100000020001300041245012900054210006900183300001200252490000700264100001300271700001400284700001400298700001300312700002200325856012200347 2005 eng d a0003999300aAssessing Mobility in Children Using a Computer Adaptive Testing Version of the Pediatric Evaluation of Disability Inventory0 aAssessing Mobility in Children Using a Computer Adaptive Testing a932-9390 v861 aHaley, S1 aRaczek, A1 aCoster, W1 aDumas, H1 aFragalapinkham, M uhttp://www.iacat.org/content/assessing-mobility-children-using-computer-adaptive-testing-version-pediatric-evaluation02791nas a2200469 4500008004100000020002200041245010400063210006900167250001500236260000800251300001200259490000700271520132800278653002201606653003101628653001501659653001601674653001001690653003401700653002101734653002401755653002501779653001501804653001101819653005301830653002901883653001101912653001101923653002001934653000901954653003101963653004601994653003102040653001402071653003202085100001502117700001002132700002502142700001702167700001302184856012402197 2005 eng d a0012-1622 (Print)00aA computer adaptive testing approach for assessing physical functioning in children and adolescents0 acomputer adaptive testing approach for assessing physical functi a2005/02/15 cFeb a113-1200 v473 aThe purpose of this article is to demonstrate: (1) the accuracy and (2) the reduction in amount of time and effort in assessing physical functioning (self-care and mobility domains) of children and adolescents using computer-adaptive testing (CAT). A CAT algorithm selects questions directly tailored to the child's ability level, based on previous responses. Using a CAT algorithm, a simulation study was used to determine the number of items necessary to approximate the score of a full-length assessment. We built simulated CAT (5-, 10-, 15-, and 20-item versions) for self-care and mobility domains and tested their accuracy in a normative sample (n=373; 190 males, 183 females; mean age 6y 11mo [SD 4y 2m], range 4mo to 14y 11mo) and a sample of children and adolescents with Pompe disease (n=26; 21 males, 5 females; mean age 6y 1mo [SD 3y 10mo], range 5mo to 14y 10mo). Results indicated that comparable score estimates (based on computer simulations) to the full-length tests can be achieved in a 20-item CAT version for all age ranges and for normative and clinical samples. No more than 13 to 16% of the items in the full-length tests were needed for any one administration. These results support further consideration of using CAT programs for accurate and efficient clinical assessments of physical functioning.10a*Computer Systems10aActivities of Daily Living10aAdolescent10aAge Factors10aChild10aChild Development/*physiology10aChild, Preschool10aComputer Simulation10aConfidence Intervals10aDemography10aFemale10aGlycogen Storage Disease Type II/physiopathology10aHealth Status Indicators10aHumans10aInfant10aInfant, Newborn10aMale10aMotor Activity/*physiology10aOutcome Assessment (Health Care)/*methods10aReproducibility of Results10aSelf Care10aSensitivity and Specificity1 aHaley, S M1 aNi, P1 aFragala-Pinkham, M A1 aSkrinar, A M1 aCorzo, D uhttp://www.iacat.org/content/computer-adaptive-testing-approach-assessing-physical-functioning-children-and-adolescents02352nas a2200193 4500008004100000245008700041210006900128300001200197490000700209520170500216653003001921653002201951653001401973653002801987653001302015100001002028700001302038856010702051 2005 eng d00aA computer-assisted test design and diagnosis system for use by classroom teachers0 acomputerassisted test design and diagnosis system for use by cla a419-4290 v213 aComputer-assisted assessment (CAA) has become increasingly important in education in recent years. A variety of computer software systems have been developed to help assess the performance of students at various levels. However, such systems are primarily designed to provide objective assessment of students and analysis of test items, and focus has been mainly placed on higher and further education. Although there are commercial professional systems available for use by primary and secondary educational institutions, such systems are generally expensive and require skilled expertise to operate. In view of the rapid progress made in the use of computer-based assessment for primary and secondary students by education authorities here in the UK and elsewhere, there is a need to develop systems which are economic and easy to use and can provide the necessary information that can help teachers improve students' performance. This paper presents the development of a software system that provides a range of functions including generating items and building item banks, designing tests, conducting tests on computers and analysing test results. Specifically, the system can generate information on the performance of students and test items that can be easily used to identify curriculum areas where students are under performing. A case study based on data collected from five secondary schools in Hong Kong involved in the Curriculum, Evaluation and Management Centre's Middle Years Information System Project, Durham University, UK, has been undertaken to demonstrate the use of the system for diagnostic and performance analysis. (PsycINFO Database Record (c) 2006 APA ) (journal abstract)10aComputer Assisted Testing10aComputer Software10aDiagnosis10aEducational Measurement10aTeachers1 aHe, Q1 aTymms, P uhttp://www.iacat.org/content/computer-assisted-test-design-and-diagnosis-system-use-classroom-teachers02219nas a2200241 4500008004100000020004100041245009600082210006900178250001500247260000800262300001100270490000700281520139600288653002701684653003701711653002701748653001101775653002601786100001501812700001901827700001301846856011801859 2005 eng d a0007-1102 (Print)0007-1102 (Linking)00aComputerized adaptive testing: a mixture item selection approach for constrained situations0 aComputerized adaptive testing a mixture item selection approach  a2005/11/19 cNov a239-570 v583 aIn computerized adaptive testing (CAT), traditionally the most discriminating items are selected to provide the maximum information so as to attain the highest efficiency in trait (theta) estimation. The maximum information (MI) approach typically results in unbalanced item exposure and hence high item-overlap rates across examinees. Recently, Yi and Chang (2003) proposed the multiple stratification (MS) method to remedy the shortcomings of MI. In MS, items are first sorted according to content, then difficulty and finally discrimination parameters. As discriminating items are used strategically, MS offers a better utilization of the entire item pool. However, for testing with imposed non-statistical constraints, this new stratification approach may not maintain its high efficiency. Through a series of simulation studies, this research explored the possible benefits of a mixture item selection approach (MS-MI), integrating the MS and MI approaches, in testing with non-statistical constraints. In all simulation conditions, MS consistently outperformed the other two competing approaches in item pool utilization, while the MS-MI and the MI approaches yielded higher measurement efficiency and offered better conformity to the constraints. Furthermore, the MS-MI approach was shown to perform better than MI on all evaluation criteria when control of item exposure was imposed.10a*Computer-Aided Design10a*Educational Measurement/methods10a*Models, Psychological10aHumans10aPsychometrics/methods1 aLeung, C K1 aChang, Hua-Hua1 aHau, K T uhttp://www.iacat.org/content/computerized-adaptive-testing-mixture-item-selection-approach-constrained-situations00685nas a2200121 4500008004100000245017000041210006900211260011000280100001800390700002000408700001600428856011900444 2005 eng d00aComputerizing statewide assessments in Minnesota: A report on the feasibility of converting the Minnesota Comprehensive Assessments to a computerized adaptive format0 aComputerizing statewide assessments in Minnesota A report on the bOffice of Educational Accountability, College of Education and Human Development, University of Minnesota1 aPeterson, K A1 aL., Davison., M1 aHjelseth, L uhttp://www.iacat.org/content/computerizing-statewide-assessments-minnesota-report-feasibility-converting-minnesota02123nas a2200253 4500008004100000245007900041210006900120300001200189490000700201520113300208653002701341653004601368653005201414653002901466653001101495653005601506653002501562653004101587653004501628653006201673100001501735700001501750856010401765 2005 eng d00aContemporary measurement techniques for rehabilitation outcomes assessment0 aContemporary measurement techniques for rehabilitation outcomes  a339-3450 v373 aIn this article, we review the limitations of traditional rehabilitation functional outcome instruments currently in use within the rehabilitation field to assess Activity and Participation domains as defined by the International Classification of Function, Disability, and Health. These include a narrow scope of functional outcomes, data incompatibility across instruments, and the precision vs feasibility dilemma. Following this, we illustrate how contemporary measurement techniques, such as item response theory methods combined with computer adaptive testing methodology, can be applied in rehabilitation to design functional outcome instruments that are comprehensive in scope, accurate, allow for compatibility across instruments, and are sensitive to clinically important change without sacrificing their feasibility. Finally, we present some of the pressing challenges that need to be overcome to provide effective dissemination and training assistance to ensure that current and future generations of rehabilitation professionals are familiar with and skilled in the application of contemporary outcomes measurement.10a*Disability Evaluation10aActivities of Daily Living/classification10aDisabled Persons/classification/*rehabilitation10aHealth Status Indicators10aHumans10aOutcome Assessment (Health Care)/*methods/standards10aRecovery of Function10aResearch Support, N.I.H., Extramural10aResearch Support, U.S. Gov't, Non-P.H.S.10aSensitivity and Specificity computerized adaptive testing1 aJette, A M1 aHaley, S M uhttp://www.iacat.org/content/contemporary-measurement-techniques-rehabilitation-outcomes-assessment00498nas a2200121 4500008004100000245010000041210006900141300001200210490001000222100000700232700001400239856012300253 2005 eng d00aDesign and evaluation of an XML-based platform-independent computerized adaptive testing system0 aDesign and evaluation of an XMLbased platformindependent compute a230-2370 v48(2)1 aHo1 aYen, Y -C uhttp://www.iacat.org/content/design-and-evaluation-xml-based-platform-independent-computerized-adaptive-testing-system02020nas a2200193 4500008004100000245009300041210006900134300001200203490000700215520136400222653001501586653002401601653001101625653002201636100001801658700001801676700001901694856011301713 2005 eng d00aInfeasibility in automated test assembly models: A comparison study of different methods0 aInfeasibility in automated test assembly models A comparison stu a223-2430 v423 aSeveral techniques exist to automatically put together a test meeting a number of specifications. In an item bank, the items are stored with their characteristics. A test is constructed by selecting a set of items that fulfills the specifications set by the test assembler. Test assembly problems are often formulated in terms of a model consisting of restrictions and an objective to be maximized or minimized. A problem arises when it is impossible to construct a test from the item pool that meets all specifications, that is, when the model is not feasible. Several methods exist to handle these infeasibility problems. In this article, test assembly models resulting from two practical testing programs were reconstructed to be infeasible. These models were analyzed using methods that forced a solution (Goal Programming, Multiple-Goal Programming, Greedy Heuristic), that analyzed the causes (Relaxed and Ordered Deletion Algorithm (RODA), Integer Randomized Deletion Algorithm (IRDA), Set Covering (SC), and Item Sampling), or that analyzed the causes and used this information to force a solution (Irreducible Infeasible Set-Solver). Specialized methods such as the IRDA and the Irreducible Infeasible Set-Solver performed best. Recommendations about the use of different methods are given. (PsycINFO Database Record (c) 2005 APA ) (journal abstract)10aAlgorithms10aItem Content (Test)10aModels10aTest Construction1 aHuitzing, H A1 aVeldkamp, B P1 aVerschoor, A J uhttp://www.iacat.org/content/infeasibility-automated-test-assembly-models-comparison-study-different-methods01315nas a2200229 4500008004100000020002200041245007700063210006900140260002500209300001200234490000700246520057900253653002700832653003000859653002500889100001100914700001600925700001500941700001300956700001500969856010100984 2005 eng d a0439-755X (Print)00a[Item characteristic curve equating under graded response models in IRT]0 aItem characteristic curve equating under graded response models  bScience Press: China a832-8380 v373 aIn one of the largest qualificatory tests--economist test, to guarantee the comparability among different years, construct item bank and prepare for computerized adaptive testing, item characteristic curve equating and anchor test equating design under graded models in IRT are used, which have realized the item and ability parameter equating of test data in five years and succeeded in establishing an item bank. Based on it, cut scores of different years are compared by equating and provide demonstrational gist to constitute the eligibility standard of economist test. 10agraded response models10aitem characteristic curve10aItem Response Theory1 aJun, Z1 aDongming, O1 aShuyuan, X1 aHaiqi, D1 aShuqing, Q uhttp://www.iacat.org/content/item-characteristic-curve-equating-under-graded-response-models-irt02902nas a2200409 4500008004100000245012300041210006900164260000800233300001000241490000700251520159700258653004701855653001001902653000901912653001901921653003101940653002601971653001101997653002902008653001102037653000902048653001602057653003902073653001402112653002502126653002702151653003002178653003202208653002802240653002202268100001502290700001602305700001702321700001602338700001502354856012302369 2005 eng d00aMeasuring physical function in patients with complex medical and postsurgical conditions: a computer adaptive approach0 aMeasuring physical function in patients with complex medical and cOct a741-80 v843 aOBJECTIVE: To examine whether the range of disability in the medically complex and postsurgical populations receiving rehabilitation is adequately sampled by the new Activity Measure--Post-Acute Care (AM-PAC), and to assess whether computer adaptive testing (CAT) can derive valid patient scores using fewer questions. DESIGN: Observational study of 158 subjects (mean age 67.2 yrs) receiving skilled rehabilitation services in inpatient (acute rehabilitation hospitals, skilled nursing facility units) and community (home health services, outpatient departments) settings for recent-onset or worsening disability from medical (excluding neurological) and surgical (excluding orthopedic) conditions. Measures were interviewer-administered activity questions (all patients) and physical functioning portion of the SF-36 (outpatients) and standardized chart items (11 Functional Independence Measure (FIM), 19 Standardized Outcome and Assessment Information Set (OASIS) items, and 22 Minimum Data Set (MDS) items). Rasch modeling analyzed all data and the relationship between person ability estimates and average item difficulty. CAT assessed the ability to derive accurate patient scores using a sample of questions. RESULTS: The 163-item activity item pool covered the range of physical movement and personal and instrumental activities. CAT analysis showed comparable scores between estimates using 10 items or the total item pool. CONCLUSION: The AM-PAC can assess a broad range of function in patients with complex medical illness. CAT achieves valid patient scores using fewer questions.10aActivities of Daily Living/*classification10aAdult10aAged10aCohort Studies10aContinuity of Patient Care10aDisability Evaluation10aFemale10aHealth Services Research10aHumans10aMale10aMiddle Aged10aPostoperative Care/*rehabilitation10aPrognosis10aRecovery of Function10aRehabilitation Centers10aRehabilitation/*standards10aSensitivity and Specificity10aSickness Impact Profile10aTreatment Outcome1 aSiebens, H1 aAndres, P L1 aPengsheng, N1 aCoster, W J1 aHaley, S M uhttp://www.iacat.org/content/measuring-physical-function-patients-complex-medical-and-postsurgical-conditions-computer02854nas a2200241 4500008004100000245018600041210007000227300001200297490000700309520195000316653003002266653002502296653001802321653002502339653001802364653001802382653001102400100001402411700001502425700001902440700002002459856013302479 2005 eng d00aPropiedades psicométricas de un test Adaptativo Informatizado para la medición del ajuste emocional [Psychometric properties of an Emotional Adjustment Computerized Adaptive Test]0 aPropiedades psicométricas de un test Adaptativo Informatizado pa a484-4910 v173 aEn el presente trabajo se describen las propiedades psicométricas de un Test Adaptativo Informatizado para la medición del ajuste emocional de las personas. La revisión de la literatura acerca de la aplicación de los modelos de la teoría de la respuesta a los ítems (TRI) muestra que ésta se ha utilizado más en el trabajo con variables aptitudinales que para la medición de variables de personalidad, sin embargo diversos estudios han mostrado la eficacia de la TRI para la descripción psicométrica de dichasvariables. Aun así, pocos trabajos han explorado las características de un Test Adaptativo Informatizado, basado en la TRI, para la medición de una variable de personalidad como es el ajuste emocional. Nuestros resultados muestran la eficiencia del TAI para la evaluación del ajuste emocional, proporcionando una medición válida y precisa, utilizando menor número de elementos de medida encomparación con las escalas de ajuste emocional de instrumentos fuertemente implantados. Psychometric properties of an emotional adjustment computerized adaptive test. In the present work it was described the psychometric properties of an emotional adjustment computerized adaptive test. An examination of Item Response Theory (IRT) research literature indicates that IRT has been mainly used for assessing achievements and ability rather than personality factors. Nevertheless last years have shown several studies wich have successfully used IRT to personality assessment instruments. Even so, a few amount of works has inquired the computerized adaptative test features, based on IRT, for the measurement of a personality traits as it’s the emotional adjustment. Our results show the CAT efficiency for the emotional adjustment assessment so this provides a valid and accurate measurement; by using a less number of items in comparison with the emotional adjustment scales from the most strongly established questionnaires.10aComputer Assisted Testing10aEmotional Adjustment10aItem Response10aPersonality Measures10aPsychometrics10aTest Validity10aTheory1 aAguado, D1 aRubio, V J1 aHontangas, P M1 aHernández, J M uhttp://www.iacat.org/content/propiedades-psicom%C3%A9tricas-de-un-test-adaptativo-informatizado-para-la-medici%C3%B3n-del-ajuste01737nas a2200181 4500008004100000245014500041210006900186300001200255490000700267520104600274653003001320653002401350653001501374100001301389700001701402700002101419856011501440 2005 eng d00aA randomized experiment to compare conventional, computerized, and computerized adaptive administration of ordinal polytomous attitude items0 arandomized experiment to compare conventional computerized and c a159-1830 v293 aA total of 520 high school students were randomly assigned to a paper-and-pencil test (PPT), a computerized standard test (CST), or a computerized adaptive test (CAT) version of the Dutch School Attitude Questionnaire (SAQ), consisting of ordinal polytomous items. The CST administered items in the same order as the PPT. The CAT administered all items of three SAQ subscales in adaptive order using Samejima's graded response model, so that six different stopping rule settings could be applied afterwards. School marks were used as external criteria. Results showed significant but small multivariate administration mode effects on conventional raw scores and small to medium effects on maximum likelihood latent trait estimates. When the precision of CAT latent trait estimates decreased, correlations with grade point average in general decreased. However, the magnitude of the decrease was not very large as compared to the PPT, the CST, and the CAT without the stopping rule. (PsycINFO Database Record (c) 2005 APA ) (journal abstract)10aComputer Assisted Testing10aTest Administration10aTest Items1 aHol, A M1 aVorst, H C M1 aMellenbergh, G J uhttp://www.iacat.org/content/randomized-experiment-compare-conventional-computerized-and-computerized-adaptive01542nas a2200145 4500008003900000245014500039210006900184300001200253490000700265520100100272100002001273700002301293700002701316856005301343 2005 d00aA Randomized Experiment to Compare Conventional, Computerized, and Computerized Adaptive Administration of Ordinal Polytomous Attitude Items0 aRandomized Experiment to Compare Conventional Computerized and C a159-1830 v293 a

A total of 520 high school students were randomly assigned to a paper-and-pencil test (PPT), a computerized standard test (CST), or a computerized adaptive test (CAT) version of the Dutch School Attitude Questionnaire (SAQ), consisting of ordinal polytomous items. The CST administered items in the same order as the PPT. The CAT administered all items of three SAQ subscales in adaptive order using Samejima’s graded response model, so that six different stopping rule settings could be applied afterwards. School marks were used as external criteria. Results showed significant but small multivariate administration mode effects on conventional raw scores and small to medium effects on maximum likelihood latent trait estimates. When the precision of CAT latent trait estimates decreased, correlations with grade point average in general decreased. However, the magnitude of the decrease was not very large as compared to the PPT, the CST, and the CAT without the stopping rule.

1 aHol, Michiel, A1 aVorst, Harrie, C M1 aMellenbergh, Gideon, J uhttp://apm.sagepub.com/content/29/3/159.abstract02720nas a2200373 4500008004100000245017500041210006900216300001100285490000700296520137800303653003001681653003101711653001501742653001001757653000901767653002201776653003201798653004201830653001101872653003001883653001101913653005101924653003101975653003702006653000902043653001602052653004102068653004102109653002602150100001402176700001802190700001902208856011902227 2005 eng d00aSimulated computerized adaptive tests for measuring functional status were efficient with good discriminant validity in patients with hip, knee, or foot/ankle impairments0 aSimulated computerized adaptive tests for measuring functional s a629-380 v583 aBACKGROUND AND OBJECTIVE: To develop computerized adaptive tests (CATs) designed to assess lower extremity functional status (FS) in people with lower extremity impairments using items from the Lower Extremity Functional Scale and compare discriminant validity of FS measures generated using all items analyzed with a rating scale Item Response Theory model (theta(IRT)) and measures generated using the simulated CATs (theta(CAT)). METHODS: Secondary analysis of retrospective intake rehabilitation data. RESULTS: Unidimensionality of items was strong, and local independence of items was adequate. Differential item functioning (DIF) affected item calibration related to body part, that is, hip, knee, or foot/ankle, but DIF did not affect item calibration for symptom acuity, gender, age, or surgical history. Therefore, patients were separated into three body part specific groups. The rating scale model fit all three data sets well. Three body part specific CATs were developed: each was 70% more efficient than using all LEFS items to estimate FS measures. theta(IRT) and theta(CAT) measures discriminated patients by symptom acuity, age, and surgical history in similar ways. theta(CAT) measures were as precise as theta(IRT) measures. CONCLUSION: Body part-specific simulated CATs were efficient and produced precise measures of FS with good discriminant validity.10a*Health Status Indicators10aActivities of Daily Living10aAdolescent10aAdult10aAged10aAged, 80 and over10aAnkle Joint/physiopathology10aDiagnosis, Computer-Assisted/*methods10aFemale10aHip Joint/physiopathology10aHumans10aJoint Diseases/physiopathology/*rehabilitation10aKnee Joint/physiopathology10aLower Extremity/*physiopathology10aMale10aMiddle Aged10aResearch Support, N.I.H., Extramural10aResearch Support, U.S. Gov't, P.H.S.10aRetrospective Studies1 aHart, D L1 aMioduski, J E1 aStratford, P W uhttp://www.iacat.org/content/simulated-computerized-adaptive-tests-measuring-functional-status-were-efficient-good01472nas a2200217 4500008004100000245004600041210004600087300001200133490000700145520085100152653001801003653002501021653003201046653001301078653002201091653002401113653001501137100001601152700001501168856007101183 2005 eng d00aTest construction for cognitive diagnosis0 aTest construction for cognitive diagnosis a262-2770 v293 aAlthough cognitive diagnostic models (CDMs) can be useful in the analysis and interpretation of existing tests, little has been developed to specify how one might construct a good test using aspects of the CDMs. This article discusses the derivation of a general CDM index based on Kullback-Leibler information that will serve as a measure of how informative an item is for the classification of examinees. The effectiveness of the index is examined for items calibrated using the deterministic input noisy "and" gate model (DINA) and the reparameterized unified model (RUM) by implementing a simple heuristic to construct a test from an item bank. When compared to randomly constructed tests from the same item bank, the heuristic shows significant improvement in classification rates. (PsycINFO Database Record (c) 2005 APA ) (journal abstract)10a(Measurement)10aCognitive Assessment10aItem Analysis (Statistical)10aProfiles10aTest Construction10aTest Interpretation10aTest Items1 aHenson, R K1 aDouglas, J uhttp://www.iacat.org/content/test-construction-cognitive-diagnosis10201nas a2200553 4500008004100000245016300041210006900204300001400273490000700287520862500294653001808919653003208937100001608969700001608985700001409001700001609015700001409031700001509045700001609060700001409076700001509090700001509105700001409120700001709134700001709151700001709168700001609185700001709201700001609218700001509234700001609249700001709265700002309282700001609305700002209321700001609343700001609359700001709375700001309392700001509405700001309420700001609433700001209449700001409461700001609475700002009491700001209511856012409523 2005 eng d00aToward efficient and comprehensive measurement of the alcohol problems continuum in college students: The Brief Young Adult Alcohol Consequences Questionnaire0 aToward efficient and comprehensive measurement of the alcohol pr a1180-11890 v293 aBackground: Although a number of measures of alcohol problems in college students have been studied, the psychometric development and validation of these scales have been limited, for the most part, to methods based on classical test theory. In this study, we conducted analyses based on item response theory to select a set of items for measuring the alcohol problem severity continuum in college students that balances comprehensiveness and efficiency and is free from significant gender bias., Method: We conducted Rasch model analyses of responses to the 48-item Young Adult Alcohol Consequences Questionnaire by 164 male and 176 female college students who drank on at least a weekly basis. An iterative process using item fit statistics, item severities, item discrimination parameters, model residuals, and analysis of differential item functioning by gender was used to pare the items down to those that best fit a Rasch model and that were most efficient in discriminating among levels of alcohol problems in the sample., Results: The process of iterative Rasch model analyses resulted in a final 24-item scale with the data fitting the unidimensional Rasch model very well. The scale showed excellent distributional properties, had items adequately matched to the severity of alcohol problems in the sample, covered a full range of problem severity, and appeared highly efficient in retaining all of the meaningful variance captured by the original set of 48 items., Conclusions: The use of Rasch model analyses to inform item selection produced a final scale that, in both its comprehensiveness and its efficiency, should be a useful tool for researchers studying alcohol problems in college students. To aid interpretation of raw scores, examples of the types of alcohol problems that are likely to be experienced across a range of selected scores are provided., (C)2005Research Society on AlcoholismAn important, sometimes controversial feature of all psychological phenomena is whether they are categorical or dimensional. A conceptual and psychometric framework is described for distinguishing whether the latent structure behind manifest categories (e.g., psychiatric diagnoses, attitude groups, or stages of development) is category-like or dimension-like. Being dimension-like requires (a) within-category heterogeneity and (b) between-category quantitative differences. Being category-like requires (a) within-category homogeneity and (b) between-category qualitative differences. The relation between this classification and abrupt versus smooth differences is discussed. Hybrid structures are possible. Being category-like is itself a matter of degree; the authors offer a formalized framework to determine this degree. Empirical applications to personality disorders, attitudes toward capital punishment, and stages of cognitive development illustrate the approach., (C) 2005 by the American Psychological AssociationThe authors conducted Rasch model ( G. Rasch, 1960) analyses of items from the Young Adult Alcohol Problems Screening Test (YAAPST; S. C. Hurlbut & K. J. Sher, 1992) to examine the relative severity and ordering of alcohol problems in 806 college students. Items appeared to measure a single dimension of alcohol problem severity, covering a broad range of the latent continuum. Items fit the Rasch model well, with less severe symptoms reliably preceding more severe symptoms in a potential progression toward increasing levels of problem severity. However, certain items did not index problem severity consistently across demographic subgroups. A shortened, alternative version of the YAAPST is proposed, and a norm table is provided that allows for a linking of total YAAPST scores to expected symptom expression., (C) 2004 by the American Psychological AssociationA didactic on latent growth curve modeling for ordinal outcomes is presented. The conceptual aspects of modeling growth with ordinal variables and the notion of threshold invariance are illustrated graphically using a hypothetical example. The ordinal growth model is described in terms of 3 nested models: (a) multivariate normality of the underlying continuous latent variables (yt) and its relationship with the observed ordinal response pattern (Yt), (b) threshold invariance over time, and (c) growth model for the continuous latent variable on a common scale. Algebraic implications of the model restrictions are derived, and practical aspects of fitting ordinal growth models are discussed with the help of an empirical example and Mx script ( M. C. Neale, S. M. Boker, G. Xie, & H. H. Maes, 1999). The necessary conditions for the identification of growth models with ordinal data and the methodological implications of the model of threshold invariance are discussed., (C) 2004 by the American Psychological AssociationRecent research points toward the viability of conceptualizing alcohol problems as arrayed along a continuum. Nevertheless, modern statistical techniques designed to scale multiple problems along a continuum (latent trait modeling; LTM) have rarely been applied to alcohol problems. This study applies LTM methods to data on 110 problems reported during in-person interviews of 1,348 middle-aged men (mean age = 43) from the general population. The results revealed a continuum of severity linking the 110 problems, ranging from heavy and abusive drinking, through tolerance and withdrawal, to serious complications of alcoholism. These results indicate that alcohol problems can be arrayed along a dimension of severity and emphasize the relevance of LTM to informing the conceptualization and assessment of alcohol problems., (C) 2004 by the American Psychological AssociationItem response theory (IRT) is supplanting classical test theory as the basis for measures development. This study demonstrated the utility of IRT for evaluating DSM-IV diagnostic criteria. Data on alcohol, cannabis, and cocaine symptoms from 372 adult clinical participants interviewed with the Composite International Diagnostic Interview-Expanded Substance Abuse Module (CIDI-SAM) were analyzed with Mplus ( B. Muthen & L. Muthen, 1998) and MULTILOG ( D. Thissen, 1991) software. Tolerance and legal problems criteria were dropped because of poor fit with a unidimensional model. Item response curves, test information curves, and testing of variously constrained models suggested that DSM-IV criteria in the CIDI-SAM discriminate between only impaired and less impaired cases and may not be useful to scale case severity. IRT can be used to study the construct validity of DSM-IV diagnoses and to identify diagnostic criteria with poor performance., (C) 2004 by the American Psychological AssociationThis study examined the psychometric characteristics of an index of substance use involvement using item response theory. The sample consisted of 292 men and 140 women who qualified for a Diagnostic and Statistical Manual of Mental Disorders (3rd ed., rev.; American Psychiatric Association, 1987) substance use disorder (SUD) diagnosis and 293 men and 445 women who did not qualify for a SUD diagnosis. The results indicated that men had a higher probability of endorsing substance use compared with women. The index significantly predicted health, psychiatric, and psychosocial disturbances as well as level of substance use behavior and severity of SUD after a 2-year follow-up. Finally, this index is a reliable and useful prognostic indicator of the risk for SUD and the medical and psychosocial sequelae of drug consumption., (C) 2002 by the American Psychological AssociationComparability, validity, and impact of loss of information of a computerized adaptive administration of the Minnesota Multiphasic Personality Inventory-2 (MMPI-2) were assessed in a sample of 140 Veterans Affairs hospital patients. The countdown method ( Butcher, Keller, & Bacon, 1985) was used to adaptively administer Scales L (Lie) and F (Frequency), the 10 clinical scales, and the 15 content scales. Participants completed the MMPI-2 twice, in 1 of 2 conditions: computerized conventional test-retest, or computerized conventional-computerized adaptive. Mean profiles and test-retest correlations across modalities were comparable. Correlations between MMPI-2 scales and criterion measures supported the validity of the countdown method, although some attenuation of validity was suggested for certain health-related items. Loss of information incurred with this mode of adaptive testing has minimal impact on test validity. Item and time savings were substantial., (C) 1999 by the American Psychological Association10aPsychometrics10aSubstance-Related Disorders1 aKahler, C W1 aStrong, D R1 aRead, J P1 aDe Boeck, P1 aWilson, M1 aActon, G S1 aPalfai, T P1 aWood, M D1 aMehta, P D1 aNeale, M C1 aFlay, B R1 aConklin, C A1 aClayton, R R1 aTiffany, S T1 aShiffman, S1 aKrueger, R F1 aNichol, P E1 aHicks, B M1 aMarkon, K E1 aPatrick, C J1 aIacono, William, G1 aMcGue, Matt1 aLangenbucher, J W1 aLabouvie, E1 aMartin, C S1 aSanjuan, P M1 aBavly, L1 aKirisci, L1 aChung, T1 aVanyukov, M1 aDunn, M1 aTarter, R1 aHandel, R W1 aBen-Porath, Y S1 aWatt, M uhttp://www.iacat.org/content/toward-efficient-and-comprehensive-measurement-alcohol-problems-continuum-college-students03707nas a2200481 4500008004100000245005200041210005200093300001200145490000700157520221100164653001902375653002902394653005802423653001002481653005302491653000902544653001102553653002502564653002602589653003302615653001102648653001002659653000902669653001602678653002402694653007402718653001802792653002902810653005802839653003102897653003202928653003602960653003202996100001503028700001603043700001603059700001603075700001003091700001403101700001803115700001503133856007703148 2004 eng d00aActivity outcome measurement for postacute care0 aActivity outcome measurement for postacute care aI49-1610 v423 aBACKGROUND: Efforts to evaluate the effectiveness of a broad range of postacute care services have been hindered by the lack of conceptually sound and comprehensive measures of outcomes. It is critical to determine a common underlying structure before employing current methods of item equating across outcome instruments for future item banking and computer-adaptive testing applications. OBJECTIVE: To investigate the factor structure, reliability, and scale properties of items underlying the Activity domains of the International Classification of Functioning, Disability and Health (ICF) for use in postacute care outcome measurement. METHODS: We developed a 41-item Activity Measure for Postacute Care (AM-PAC) that assessed an individual's execution of discrete daily tasks in his or her own environment across major content domains as defined by the ICF. We evaluated the reliability and discriminant validity of the prototype AM-PAC in 477 individuals in active rehabilitation programs across 4 rehabilitation settings using factor analyses, tests of item scaling, internal consistency reliability analyses, Rasch item response theory modeling, residual component analysis, and modified parallel analysis. RESULTS: Results from an initial exploratory factor analysis produced 3 distinct, interpretable factors that accounted for 72% of the variance: Applied Cognition (44%), Personal Care & Instrumental Activities (19%), and Physical & Movement Activities (9%); these 3 activity factors were verified by a confirmatory factor analysis. Scaling assumptions were met for each factor in the total sample and across diagnostic groups. Internal consistency reliability was high for the total sample (Cronbach alpha = 0.92 to 0.94), and for specific diagnostic groups (Cronbach alpha = 0.90 to 0.95). Rasch scaling, residual factor, differential item functioning, and modified parallel analyses supported the unidimensionality and goodness of fit of each unique activity domain. CONCLUSIONS: This 3-factor model of the AM-PAC can form the conceptual basis for common-item equating and computer-adaptive applications, leading to a comprehensive system of outcome instruments for postacute care settings.10a*Self Efficacy10a*Sickness Impact Profile10aActivities of Daily Living/*classification/psychology10aAdult10aAftercare/*standards/statistics & numerical data10aAged10aBoston10aCognition/physiology10aDisability Evaluation10aFactor Analysis, Statistical10aFemale10aHuman10aMale10aMiddle Aged10aMovement/physiology10aOutcome Assessment (Health Care)/*methods/statistics & numerical data10aPsychometrics10aQuestionnaires/standards10aRehabilitation/*standards/statistics & numerical data10aReproducibility of Results10aSensitivity and Specificity10aSupport, U.S. Gov't, Non-P.H.S.10aSupport, U.S. Gov't, P.H.S.1 aHaley, S M1 aCoster, W J1 aAndres, P L1 aLudlow, L H1 aNi, P1 aBond, T L1 aSinclair, S J1 aJette, A M uhttp://www.iacat.org/content/activity-outcome-measurement-postacute-care02776nas a2200421 4500008004100000020004600041245011200087210006900199250001500268260001000283300000700293490000600300520144100306653002701747653003001774653004701804653001001851653000901861653002201870653002801892653001101920653001101931653002001942653000901962653001601971653001601987653001902003653001602022653003502038653002902073653004002102653003002142100001402172700001702186700001702203700001402220856012002234 2004 eng d a1477-7525 (Electronic)1477-7525 (Linking)00aThe AMC Linear Disability Score project in a population requiring residential care: psychometric properties0 aAMC Linear Disability Score project in a population requiring re a2004/08/05 cAug 3 a420 v23 aBACKGROUND: Currently there is a lot of interest in the flexible framework offered by item banks for measuring patient relevant outcomes, including functional status. However, there are few item banks, which have been developed to quantify functional status, as expressed by the ability to perform activities of daily life. METHOD: This paper examines the psychometric properties of the AMC Linear Disability Score (ALDS) project item bank using an item response theory model and full information factor analysis. Data were collected from 555 respondents on a total of 160 items. RESULTS: Following the analysis, 79 items remained in the item bank. The remaining 81 items were excluded because of: difficulties in presentation (1 item); low levels of variation in response pattern (28 items); significant differences in measurement characteristics for males and females or for respondents under or over 85 years old (26 items); or lack of model fit to the data at item level (26 items). CONCLUSIONS: It is conceivable that the item bank will have different measurement characteristics for other patient or demographic populations. However, these results indicate that the ALDS item bank has sound psychometric properties for respondents in residential care settings and could form a stable base for measuring functional status in a range of situations, including the implementation of computerised adaptive testing of functional status.10a*Disability Evaluation10a*Health Status Indicators10aActivities of Daily Living/*classification10aAdult10aAged10aAged, 80 and over10aData Collection/methods10aFemale10aHumans10aLogistic Models10aMale10aMiddle Aged10aNetherlands10aPilot Projects10aProbability10aPsychometrics/*instrumentation10aQuestionnaires/standards10aResidential Facilities/*utilization10aSeverity of Illness Index1 aHolman, R1 aLindeboom, R1 aVermeulen, M1 aHaan, R J uhttp://www.iacat.org/content/amc-linear-disability-score-project-population-requiring-residential-care-psychometric01668nas a2200229 4500008004100000245005500041210005300096300000800149490000700157520102900164653002101193653001201214653003001226653001801256653000901274100001701283700001201300700001501312700001601327700001401343856008101357 2004 eng d00aAssisted self-adapted testing: A comparative study0 aAssisted selfadapted testing A comparative study a2-90 v203 aA new type of self-adapted test (S-AT), called Assisted Self-Adapted Test (AS-AT), is presented. It differs from an ordinary S-AT in that prior to selecting the difficulty category, the computer advises examinees on their best difficulty category choice, based on their previous performance. Three tests (computerized adaptive test, AS-AT, and S-AT) were compared regarding both their psychometric (precision and efficiency) and psychological (anxiety) characteristics. Tests were applied in an actual assessment situation, in which test scores determined 20% of term grades. A sample of 173 high school students participated. Neither differences in posttest anxiety nor ability were obtained. Concerning precision, AS-AT was as precise as CAT, and both revealed more precision than S-AT. It was concluded that AS-AT acted as a CAT concerning precision. Some hints, but not conclusive support, of the psychological similarity between AS-AT and S-AT was also found. (PsycINFO Database Record (c) 2005 APA ) (journal abstract)10aAdaptive Testing10aAnxiety10aComputer Assisted Testing10aPsychometrics10aTest1 aHontangas, P1 aOlea, J1 aPonsoda, V1 aRevuelta, J1 aWise, S L uhttp://www.iacat.org/content/assisted-self-adapted-testing-comparative-study01801nas a2200361 4500008004100000020002200041245009500063210006900158250001500227260001100242300001000253490000700263520066300270653002500933653002900958653001000987653000900997653002201006653004501028653003701073653001101110653001101121653000901132653001601141653003601157653003001193653003401223100001601257700002401273700001001297700001501307856011701322 2004 eng d a1074-9357 (Print)00aComputer adaptive testing: a strategy for monitoring stroke rehabilitation across settings0 aComputer adaptive testing a strategy for monitoring stroke rehab a2004/05/01 cSpring a33-390 v113 aCurrent functional assessment instruments in stroke rehabilitation are often setting-specific and lack precision, breadth, and/or feasibility. Computer adaptive testing (CAT) offers a promising potential solution by providing a quick, yet precise, measure of function that can be used across a broad range of patient abilities and in multiple settings. CAT technology yields a precise score by selecting very few relevant items from a large and diverse item pool based on each individual's responses. We demonstrate the potential usefulness of a CAT assessment model with a cross-sectional sample of persons with stroke from multiple rehabilitation settings.10a*Computer Simulation10a*User-Computer Interface10aAdult10aAged10aAged, 80 and over10aCerebrovascular Accident/*rehabilitation10aDisabled Persons/*classification10aFemale10aHumans10aMale10aMiddle Aged10aMonitoring, Physiologic/methods10aSeverity of Illness Index10aTask Performance and Analysis1 aAndres, P L1 aBlack-Schaffer, R M1 aNi, P1 aHaley, S M uhttp://www.iacat.org/content/computer-adaptive-testing-strategy-monitoring-stroke-rehabilitation-across-settings00415nas a2200109 4500008004100000245006300041210006300104260001700167100001900184700001400203856008800217 2004 eng d00aComputer adaptive testing and the No Child Left Behind Act0 aComputer adaptive testing and the No Child Left Behind Act aSan Diego CA1 aKingsbury, G G1 aHauser, C uhttp://www.iacat.org/content/computer-adaptive-testing-and-no-child-left-behind-act00528nas a2200109 4500008004100000245009800041210006900139260006200208100001800270700001200288856011800300 2004 eng d00aComputer-based test designs with optimal and non-optimal tests for making pass-fail decisions0 aComputerbased test designs with optimal and nonoptimal tests for aResearch Report, University of Massachusetts, Amherst, MA1 aHambleton, RK1 aXing, D uhttp://www.iacat.org/content/computer-based-test-designs-optimal-and-non-optimal-tests-making-pass-fail-decisions01908nas a2200217 4500008004100000020004600041245010100087210006900188260002600257300001200283490000700295520111100302653002401413653003201437653001301469653003801482100001701520700001501537700001401552856012401566 2004 eng d a0021-9762 (Print); 1097-4679 (Electronic)00aComputers in clinical assessment: Historical developments, present status, and future challenges0 aComputers in clinical assessment Historical developments present bJohn Wiley & Sons: US a331-3450 v603 aComputerized testing methods have long been regarded as a potentially powerful asset for providing psychological assessment services. Ever since computers were first introduced and adapted to the field of assessment psychology in the 1950s, they have been a valuable aid for scoring, data processing, and even interpretation of test results. The history and status of computer-based personality and neuropsychological tests are discussed in this article. Several pertinent issues involved in providing test interpretation by computer are highlighted. Advances in computer-based test use, such as computerized adaptive testing, are described and problems noted. Today, there is great interest in expanding the availability of psychological assessment applications on the Internet. Although these applications show great promise, there are a number of problems associated with providing psychological tests on the Internet that need to be addressed by psychologists before the Internet can become a major medium for psychological service delivery. (PsycINFO Database Record (c) 2007 APA, all rights reserved)10aclinical assessment10acomputerized testing method10aInternet10apsychological assessment services1 aButcher, J N1 aPerry, J L1 aHahn, J A uhttp://www.iacat.org/content/computers-clinical-assessment-historical-developments-present-status-and-future-challenges00399nas a2200109 4500008004100000245005900041210005800100260001700158100001100175700001800186856008500204 2004 eng d00aDetecting exposed test items in computer-based testing0 aDetecting exposed test items in computerbased testing aSan Diego CA1 aHan, N1 aHambleton, RK uhttp://www.iacat.org/content/detecting-exposed-test-items-computer-based-testing01470nas a2200133 4500008003900000245013600039210006900175300000900244490000700253520098400260100001601244700002501260856005101285 2004 d00aImpact of Test Design, Item Quality, and Item Bank Size on the Psychometric Properties of Computer-Based Credentialing Examinations0 aImpact of Test Design Item Quality and Item Bank Size on the Psy a5-210 v643 a

Computer-based testing by credentialing agencies has become common; however, selecting a test design is difficult because several good ones are available—parallel forms, computer adaptive (CAT), and multistage (MST). In this study, three computerbased test designs under some common examination conditions were investigated. Item bank size and item quality had a practically significant impact on decision consistency and accuracy. Even in nearly ideal situations, the choice of test design was not a factor in the results. Two conclusions follow from the findings: (a) More time and resources should be committed to expanding the size and quality of item banks, and (b) designs that individualize an exam administration such as MST and CAT may not be helpful when the primary purpose of the examination is to make pass-fail decisions and conditions are present for using parallel forms with a target information function that can be centered on the passing score.

1 aXing, Dehui1 aHambleton, Ronald, K uhttp://epm.sagepub.com/content/64/1/5.abstract00501nas a2200109 4500008004100000245010500041210006900146260001700215100001700232700001800249856012400267 2004 eng d00aInvestigating the effects of selected multi-stage test design alternatives on credentialing outcomes0 aInvestigating the effects of selected multistage test design alt aSan Diego CA1 aZenisky, A L1 aHambleton, RK uhttp://www.iacat.org/content/investigating-effects-selected-multi-stage-test-design-alternatives-credentialing-outcomes01441nas a2200157 4500008003900000245006700039210006700106300001200173490000700185520094700192100002901139700002301168700001901191700002001210856005301230 2004 d00aMokken Scale Analysis Using Hierarchical Clustering Procedures0 aMokken Scale Analysis Using Hierarchical Clustering Procedures a332-3540 v283 a

Mokken scale analysis (MSA) can be used to assess and build unidimensional scales from an item pool that is sensitive to multiple dimensions. These scales satisfy a set of scaling conditions, one of which follows from the model of monotone homogeneity. An important drawback of the MSA program is that the sequential item selection and scale construction procedure may not find the dominant underlying dimensionality of the responses to a set of items. The authors investigated alternative hierarchical item selection procedures and compared the performance of four hierarchical methods and the sequential clustering method in the MSA context. The results showed that hierarchical clustering methods can improve the search process of the dominant dimensionality of a data matrix. In particular, the complete linkage and scale linkage methods were promising in finding the dimensionality of the item response data from a set of items.

1 aAbswoude, Alexandra, A H1 aVermunt, Jeroen, K1 aHemker, Bas, T1 aArk, Andries, L uhttp://apm.sagepub.com/content/28/5/332.abstract02843nas a2200349 4500008004100000020004600041245011400087210006900201250001500270260001100285300000700296490000600303520169400309653002702003653002002030653002102050653002002071653004702091653003702138653001802175653001102193653001902204653001602223653002002239653003002259100001402289700001402303700001702317700002002334700001402354856012502368 2004 eng d a1477-7525 (Electronic)1477-7525 (Linking)00aPractical methods for dealing with 'not applicable' item responses in the AMC Linear Disability Score project0 aPractical methods for dealing with not applicable item responses a2004/06/18 cJun 16 a290 v23 aBACKGROUND: Whenever questionnaires are used to collect data on constructs, such as functional status or health related quality of life, it is unlikely that all respondents will respond to all items. This paper examines ways of dealing with responses in a 'not applicable' category to items included in the AMC Linear Disability Score (ALDS) project item bank. METHODS: The data examined in this paper come from the responses of 392 respondents to 32 items and form part of the calibration sample for the ALDS item bank. The data are analysed using the one-parameter logistic item response theory model. The four practical strategies for dealing with this type of response are: cold deck imputation; hot deck imputation; treating the missing responses as if these items had never been offered to those individual patients; and using a model which takes account of the 'tendency to respond to items'. RESULTS: The item and respondent population parameter estimates were very similar for the strategies involving hot deck imputation; treating the missing responses as if these items had never been offered to those individual patients; and using a model which takes account of the 'tendency to respond to items'. The estimates obtained using the cold deck imputation method were substantially different. CONCLUSIONS: The cold deck imputation method was not considered suitable for use in the ALDS item bank. The other three methods described can be usefully implemented in the ALDS item bank, depending on the purpose of the data analysis to be carried out. These three methods may be useful for other data sets examining similar constructs, when item response theory based methods are used.10a*Disability Evaluation10a*Health Surveys10a*Logistic Models10a*Questionnaires10aActivities of Daily Living/*classification10aData Interpretation, Statistical10aHealth Status10aHumans10aPilot Projects10aProbability10aQuality of Life10aSeverity of Illness Index1 aHolman, R1 aGlas, C A1 aLindeboom, R1 aZwinderman, A H1 aHaan, R J uhttp://www.iacat.org/content/practical-methods-dealing-not-applicable-item-responses-amc-linear-disability-score-project04032nas a2200433 4500008004100000245012300041210006900164260000800233300001200241490000700253520252400260653001902784653002902803653005802832653001002890653000902900653002202909653002602931653003302957653001102990653001103001653000903012653001603021653007403037653003003111653003603141653005803177653003103235653004503266653004103311653003203352100001603384700001503400700001603415700001603431700001403447700001203461856012503473 2004 eng d00aRefining the conceptual basis for rehabilitation outcome measurement: personal care and instrumental activities domain0 aRefining the conceptual basis for rehabilitation outcome measure cJan aI62-1720 v423 aBACKGROUND: Rehabilitation outcome measures routinely include content on performance of daily activities; however, the conceptual basis for item selection is rarely specified. These instruments differ significantly in format, number, and specificity of daily activity items and in the measurement dimensions and type of scale used to specify levels of performance. We propose that a requirement for upper limb and hand skills underlies many activities of daily living (ADL) and instrumental activities of daily living (IADL) items in current instruments, and that items selected based on this definition can be placed along a single functional continuum. OBJECTIVE: To examine the dimensional structure and content coverage of a Personal Care and Instrumental Activities item set and to examine the comparability of items from existing instruments and a set of new items as measures of this domain. METHODS: Participants (N = 477) from 3 different disability groups and 4 settings representing the continuum of postacute rehabilitation care were administered the newly developed Activity Measure for Post-Acute Care (AM-PAC), the SF-8, and an additional setting-specific measure: FIM (in-patient rehabilitation); MDS (skilled nursing facility); MDS-PAC (postacute settings); OASIS (home care); or PF-10 (outpatient clinic). Rasch (partial-credit model) analyses were conducted on a set of 62 items covering the Personal Care and Instrumental domain to examine item fit, item functioning, and category difficulty estimates and unidimensionality. RESULTS: After removing 6 misfitting items, the remaining 56 items fit acceptably along the hypothesized continuum. Analyses yielded different difficulty estimates for the maximum score (eg, "Independent performance") for items with comparable content from different instruments. Items showed little differential item functioning across age, diagnosis, or severity groups, and 92% of the participants fit the model. CONCLUSIONS: ADL and IADL items from existing rehabilitation outcomes instruments that depend on skilled upper limb and hand use can be located along a single continuum, along with the new personal care and instrumental items of the AM-PAC addressing gaps in content. Results support the validity of the proposed definition of the Personal Care and Instrumental Activities dimension of function as a guide for future development of rehabilitation outcome instruments, such as linked, setting-specific short forms and computerized adaptive testing approaches.10a*Self Efficacy10a*Sickness Impact Profile10aActivities of Daily Living/*classification/psychology10aAdult10aAged10aAged, 80 and over10aDisability Evaluation10aFactor Analysis, Statistical10aFemale10aHumans10aMale10aMiddle Aged10aOutcome Assessment (Health Care)/*methods/statistics & numerical data10aQuestionnaires/*standards10aRecovery of Function/physiology10aRehabilitation/*standards/statistics & numerical data10aReproducibility of Results10aResearch Support, U.S. Gov't, Non-P.H.S.10aResearch Support, U.S. Gov't, P.H.S.10aSensitivity and Specificity1 aCoster, W J1 aHaley, S M1 aAndres, P L1 aLudlow, L H1 aBond, T L1 aNi, P S uhttp://www.iacat.org/content/refining-conceptual-basis-rehabilitation-outcome-measurement-personal-care-and-instrumental02888nas a2200301 4500008004100000020002200041245013700063210006900200250001500269260000800284300001000292490000700302520186600309653001102175653003302186653001102219653004602230653002402276653002902300653003002329653002902359100001502388700001602403700001602419700001602435700001002451856012502461 2004 eng d a0003-9993 (Print)00aScore comparability of short forms and computerized adaptive testing: Simulation study with the activity measure for post-acute care0 aScore comparability of short forms and computerized adaptive tes a2004/04/15 cApr a661-60 v853 aOBJECTIVE: To compare simulated short-form and computerized adaptive testing (CAT) scores to scores obtained from complete item sets for each of the 3 domains of the Activity Measure for Post-Acute Care (AM-PAC). DESIGN: Prospective study. SETTING: Six postacute health care networks in the greater Boston metropolitan area, including inpatient acute rehabilitation, transitional care units, home care, and outpatient services. PARTICIPANTS: A convenience sample of 485 adult volunteers who were receiving skilled rehabilitation services. INTERVENTIONS: Not applicable. MAIN OUTCOME MEASURES: Inpatient and community-based short forms and CAT applications were developed for each of 3 activity domains (physical & mobility, personal care & instrumental, applied cognition) using item pools constructed from new items and items from existing postacute care instruments. RESULTS: Simulated CAT scores correlated highly with score estimates from the total item pool in each domain (4- and 6-item CAT r range,.90-.95; 10-item CAT r range,.96-.98). Scores on the 10-item short forms constructed for inpatient and community settings also provided good estimates of the AM-PAC item pool scores for the physical & movement and personal care & instrumental domains, but were less consistent in the applied cognition domain. Confidence intervals around individual scores were greater in the short forms than for the CATs. CONCLUSIONS: Accurate scoring estimates for AM-PAC domains can be obtained with either the setting-specific short forms or the CATs. The strong relationship between CAT and item pool scores can be attributed to the CAT's ability to select specific items to match individual responses. The CAT may have additional advantages over short forms in practicality, efficiency, and the potential for providing more precise scoring estimates for individuals.10aBoston10aFactor Analysis, Statistical10aHumans10aOutcome Assessment (Health Care)/*methods10aProspective Studies10aQuestionnaires/standards10aRehabilitation/*standards10aSubacute Care/*standards1 aHaley, S M1 aCoster, W J1 aAndres, P L1 aKosinski, M1 aNi, P uhttp://www.iacat.org/content/score-comparability-short-forms-and-computerized-adaptive-testing-simulation-study-activity00429nas a2200121 4500008004100000022001400041245006600055210006600121490000600187100001000193700001800203856008600221 2004 eng d a1575-910500aStatistics for detecting disclosed items in a CAT environment0 aStatistics for detecting disclosed items in a CAT environment0 v51 aLu, Y1 aHambleton, RK uhttp://www.iacat.org/content/statistics-detecting-disclosed-items-cat-environment01413nas a2200121 4500008003900000245011400039210006900153300001200222490000700234520097400241100002301215856005301238 2004 d00aUsing Set Covering with Item Sampling to Analyze the Infeasibility of Linear Programming Test Assembly Models0 aUsing Set Covering with Item Sampling to Analyze the Infeasibili a355-3750 v283 a

This article shows how set covering with item sampling (SCIS) methods can be used in the analysis and preanalysis of linear programming models for test assembly (LPTA). LPTA models can construct tests, fulfilling a set of constraints set by the test assembler. Sometimes, no solution to the LPTA model exists. The model is then said to be infeasible. Causes of infeasibility can be difficult to find. A method is proposed that constitutes a helpful tool for test assemblers to detect infeasibility before hand and, in the case of infeasibility, give insight into its causes. This method is based on SCIS. Although SCIS can help to detect feasibility or infeasibility, its power lies in pinpointing causes of infeasibility such as irreducible infeasible sets of constraints. Methods to resolve infeasibility are also given, minimizing the model deviations. A simulation study is presented, offering a guide to test assemblers to analyze and solve infeasibility.

1 aHuitzing, Hiddo, A uhttp://apm.sagepub.com/content/28/5/355.abstract01114nas a2200145 4500008004100000245008300041210006900124300000900193490000600202520060700208100001500815700001900830700001300849856010600862 2003 eng d00aComputerized adaptive testing: A comparison of three content balancing methods0 aComputerized adaptive testing A comparison of three content bala a1-150 v23 aContent balancing is often a practical consideration in the design of computerized adaptive testing (CAT). This study compared three content balancing methods, namely, the constrained CAT (CCAT), the modified constrained CAT (MCCAT), and the modified multinomial model (MMM), under various conditions of test length and target maximum exposure rate. Results of a series of simulation studies indicate that there is no systematic effect of content balancing method in measurement efficiency and pool utilization. However, among the three methods, the MMM appears to consistently over-expose fewer items.1 aLeung, C-K1 aChang, Hua-Hua1 aHau, K-T uhttp://www.iacat.org/content/computerized-adaptive-testing-comparison-three-content-balancing-methods00509nas a2200133 4500008004100000245008300041210006900124260001500193100001500208700001900223700001300242700001200255856010800267 2003 eng d00aComputerized adaptive testing: A comparison of three content balancing methods0 aComputerized adaptive testing A comparison of three content bala aChicago IL1 aLeung, C-K1 aChang, Hua-Hua1 aHau, K-T1 aWen, z. uhttp://www.iacat.org/content/computerized-adaptive-testing-comparison-three-content-balancing-methods-001804nas a2200277 4500008004100000245007600041210006900117300001100186490000600197520090300203653001501106653002901121653003001150653002001180653001101200653005001211653001801261653003201279653004101311653001801352100001401370700001301384700001301397700001901410856009701429 2003 eng d00aDeveloping an initial physical function item bank from existing sources0 aDeveloping an initial physical function item bank from existing  a124-360 v43 aThe objective of this article is to illustrate incremental item banking using health-related quality of life data collected from two samples of patients receiving cancer treatment. The kinds of decisions one faces in establishing an item bank for computerized adaptive testing are also illustrated. Pre-calibration procedures include: identifying common items across databases; creating a new database with data from each pool; reverse-scoring "negative" items; identifying rating scales used in items; identifying pivot points in each rating scale; pivot anchoring items at comparable rating scale categories; and identifying items in each instrument that measure the construct of interest. A series of calibrations were conducted in which a small proportion of new items were added to the common core and misfitting items were identified and deleted until an initial item bank has been developed.10a*Databases10a*Sickness Impact Profile10aAdaptation, Psychological10aData Collection10aHumans10aNeoplasms/*physiopathology/psychology/therapy10aPsychometrics10aQuality of Life/*psychology10aResearch Support, U.S. Gov't, P.H.S.10aUnited States1 aBode, R K1 aCella, D1 aLai, J S1 aHeinemann, A W uhttp://www.iacat.org/content/developing-initial-physical-function-item-bank-existing-sources00527nas a2200121 4500008003900000245008900039210007000128260004600198100001700244700001300261700001700274856011400291 2003 d00aEffect of extra time on GRE® Quantitative and Verbal Scores (Research Report 03-13)0 aEffect of extra time on GRE® Quantitative and Verbal Scores Rese aPrinceton NJ: Educational Testing service1 aBridgeman, B1 aCline, F1 aHessinger, J uhttp://www.iacat.org/content/effect-extra-time-gre%C2%AE-quantitative-and-verbal-scores-research-report-03-1300468nas a2200133 4500008004100000245006800041210006800109260001500177100001000192700001600202700001200218700001300230856009100243 2003 eng d00aEffects of test administration mode on item parameter estimates0 aEffects of test administration mode on item parameter estimates aChicago IL1 aYi, Q1 aHarris, D J1 aWang, T1 aBan, J-C uhttp://www.iacat.org/content/effects-test-administration-mode-item-parameter-estimates00961nas a2200157 4500008004100000245011200041210006900153300001100222490000700233520035900240653003400599100001500633700001900648700001300667856012300680 2003 eng d00aIncorporation of Content Balancing Requirements in Stratification Designs for Computerized Adaptive Testing0 aIncorporation of Content Balancing Requirements in Stratificatio a257-700 v633 aStudied three stratification designs for computerized adaptive testing in conjunction with three well-developed content balancing methods. Simulation study results show substantial differences in item overlap rate and pool utilization among different methods. Recommends an optimal combination of stratification design and content balancing method. (SLD)10acomputerized adaptive testing1 aLeung, C-K1 aChang, Hua-Hua1 aHau, K-T uhttp://www.iacat.org/content/incorporation-content-balancing-requirements-stratification-designs-computerized-adaptive01586nas a2200145 4500008003900000245011200039210006900151300001200220490000700232520109100239100002101330700001901351700001701370856005301387 2003 d00aIncorporation Of Content Balancing Requirements In Stratification Designs For Computerized Adaptive Testing0 aIncorporation Of Content Balancing Requirements In Stratificatio a257-2700 v633 a

In computerized adaptive testing, the multistage a-stratified design advocates a new philosophy on pool management and item selection in which, contradictory to common practice, less discriminating items are used first. The method is effective in reducing item-overlap rate and enhancing pool utilization. This stratification method has been extended in different ways to deal with the practical issues of content constraints and the positive correlation between item difficulty and discrimination. Nevertheless, these modified designs on their own do not automatically satisfy content requirements. In this study, three stratification designs were examined in conjunction with three well developed content balancing methods. The performance of each of these nine combinational methods was evaluated in terms of their item security, measurement efficiency, and pool utilization. Results showed substantial differences in item-overlap rate and pool utilization among different methods. An optimal combination of stratification design and content balancing method is recommended.

1 aLeung, Chi-Keung1 aChang, Hua-Hua1 aHau, Kit-Tai uhttp://epm.sagepub.com/content/63/2/257.abstract02748nas a2200349 4500008004100000245015800041210006900199260000800268300001200276490000700288520160300295653003001898653002001928653001001948653003201958653001101990653001102001653000902012653001602021653002802037653001802065653003702083653004102120653002802161100001302189700001502202700001302217700001502230700001402245700001902259856012002278 2003 eng d00aItem banking to improve, shorten and computerized self-reported fatigue: an illustration of steps to create a core item bank from the FACIT-Fatigue Scale0 aItem banking to improve shorten and computerized selfreported fa cAug a485-5010 v123 aFatigue is a common symptom among cancer patients and the general population. Due to its subjective nature, fatigue has been difficult to effectively and efficiently assess. Modern computerized adaptive testing (CAT) can enable precise assessment of fatigue using a small number of items from a fatigue item bank. CAT enables brief assessment by selecting questions from an item bank that provide the maximum amount of information given a person's previous responses. This article illustrates steps to prepare such an item bank, using 13 items from the Functional Assessment of Chronic Illness Therapy Fatigue Subscale (FACIT-F) as the basis. Samples included 1022 cancer patients and 1010 people from the general population. An Item Response Theory (IRT)-based rating scale model, a polytomous extension of the Rasch dichotomous model was utilized. Nine items demonstrating acceptable psychometric properties were selected and positioned on the fatigue continuum. The fatigue levels measured by these nine items along with their response categories covered 66.8% of the general population and 82.6% of the cancer patients. Although the operational CAT algorithms to handle polytomously scored items are still in progress, we illustrated how CAT may work by using nine core items to measure level of fatigue. Using this illustration, a fatigue measure comparable to its full-length 13-item scale administration was obtained using four items. The resulting item bank can serve as a core to which will be added a psychometrically sound and operational item bank covering the entire fatigue continuum.10a*Health Status Indicators10a*Questionnaires10aAdult10aFatigue/*diagnosis/etiology10aFemale10aHumans10aMale10aMiddle Aged10aNeoplasms/complications10aPsychometrics10aResearch Support, Non-U.S. Gov't10aResearch Support, U.S. Gov't, P.H.S.10aSickness Impact Profile1 aLai, J-S1 aCrane, P K1 aCella, D1 aChang, C-H1 aBode, R K1 aHeinemann, A W uhttp://www.iacat.org/content/item-banking-improve-shorten-and-computerized-self-reported-fatigue-illustration-steps00452nas a2200145 4500008004100000245005100041210005100092260001500143100001500158700001400173700001200187700001500199700001500214856007700229 2003 eng d00aMaintaining scale in computer adaptive testing0 aMaintaining scale in computer adaptive testing aChicago IL1 aSmith, R L1 aRizavi, S1 aPaez, R1 aDamiano, M1 aHerbert, E uhttp://www.iacat.org/content/maintaining-scale-computer-adaptive-testing00516nas a2200121 4500008004100000245009800041210006900139260001500208100001600223700001800239700001700257856012000274 2003 eng d00aRecalibration of IRT item parameters in CAT: Sparse data matrices and missing data treatments0 aRecalibration of IRT item parameters in CAT Sparse data matrices aChicago IL1 aHarmes, J C1 aParshall, C G1 aKromrey, J D uhttp://www.iacat.org/content/recalibration-irt-item-parameters-cat-sparse-data-matrices-and-missing-data-treatments01711nas a2200169 4500008004100000245015800041210006900199300001000268490000700278520105400285100001901339700001801358700001601376700001201392700001601404856012101420 2003 eng d00aSmall sample estimation in dichotomous item response models: Effect of priors based on judgmental information on the accuracy of item parameter estimates0 aSmall sample estimation in dichotomous item response models Effe a27-510 v273 aLarge item banks with properly calibrated test items are essential for ensuring the validity of computer-based tests. At the same time, item calibrations with small samples are desirable to minimize the amount of pretesting and limit item exposure. Bayesian estimation procedures show considerable promise with small examinee samples. The purposes of the study were (a) to examine how prior information for Bayesian item parameter estimation can be specified and (b) to investigate the relationship between sample size and the specification of prior information on the accuracy of item parameter estimates. The results of the simulation study were clear: Estimation of item response theory (IRT) model item parameters can be improved considerably. Improvements in the one-parameter model were modest; considerable improvements with the two- and three-parameter models were observed. Both the study of different forms of priors and ways to improve the judgmental data used in forming the priors appear to be promising directions for future research. 1 aSwaminathan, H1 aHambleton, RK1 aSireci, S G1 aXing, D1 aRizavi, S M uhttp://www.iacat.org/content/small-sample-estimation-dichotomous-item-response-models-effect-priors-based-judgmental00823nas a2200133 4500008004100000245005300041210005300094300001200147490000700159520041300166100001300579700001500592856008200607 2003 eng d00aStudent modeling and ab initio language learning0 aStudent modeling and ab initio language learning a519-5350 v313 aProvides examples of student modeling techniques that have been employed in computer-assisted language learning over the past decade. Describes two systems for learning German: "German Tutor" and "Geroline." Shows how a student model can support computerized adaptive language testing for diagnostic purposes in a Web-based language learning environment that does not rely on parsing technology. (Author/VWL)1 aHeift, T1 aSchulze, M uhttp://www.iacat.org/content/student-modeling-and-ab-initio-language-learning00545nas a2200097 4500008004100000245014400041210006900185260006700254100001100321856011500332 2003 eng d00aUsing moving averages to assess test and item security in computer-based testing (Center for Educational Assessment Research Report No 468)0 aUsing moving averages to assess test and item security in comput aAmherst, MA: University of Massachusetts, School of Education.1 aHan, N uhttp://www.iacat.org/content/using-moving-averages-assess-test-and-item-security-computer-based-testing-center00618nas a2200157 4500008004100000245012800041210006900169300001300238490000700251100001700258700001600275700001500291700002100306700001300327856012000340 2002 eng d00aCan examinees use judgments of item difficulty to improve proficiency estimates on computerized adaptive vocabulary tests? 0 aCan examinees use judgments of item difficulty to improve profic a 311-3300 v391 aVispoel, W P1 aClough, S J1 aBleiler, T1 aHendrickson, A B1 aIhrig, D uhttp://www.iacat.org/content/can-examinees-use-judgments-item-difficulty-improve-proficiency-estimates-computerized00536nas a2200121 4500008004100000245011500041210006900156260001900225100001500244700001900259700001300278856012300291 2002 eng d00aComparing three item selection approaches for computerized adaptive testing with content balancing requirement0 aComparing three item selection approaches for computerized adapt aNew Orleans LA1 aLeung, C-K1 aChang, Hua-Hua1 aHau, K-T uhttp://www.iacat.org/content/comparing-three-item-selection-approaches-computerized-adaptive-testing-content-balancing00450nas a2200109 4500008004100000245009000041210006900131300001200200490000700212100001800219856010300237 2002 eng d00aA comparison of non-deterministic procedures for the adaptive assessment of knowledge0 acomparison of nondeterministic procedures for the adaptive asses a495-5030 v441 aHockemeyer, C uhttp://www.iacat.org/content/comparison-non-deterministic-procedures-adaptive-assessment-knowledge00533nas a2200121 4500008004100000245010900041210006900150260001900219100001400238700001700252700001800269856012400287 2002 eng d00aComparison of the psychometric properties of several computer-based test designs for credentialing exams0 aComparison of the psychometric properties of several computerbas aNew Orleans LA1 aJodoin, M1 aZenisky, A L1 aHambleton, RK uhttp://www.iacat.org/content/comparison-psychometric-properties-several-computer-based-test-designs-credentialing-exams01447nas a2200241 4500008004100000245008000041210006900121300001200190490000700202520067300209653003000882653002800912653002500940653002300965653001600988653002201004653002101026100001301047700001601060700001001076700001601086856010301102 2002 eng d00aData sparseness and on-line pretest item calibration-scaling methods in CAT0 aData sparseness and online pretest item calibrationscaling metho a207-2180 v393 aCompared and evaluated 3 on-line pretest item calibration-scaling methods (the marginal maximum likelihood estimate with 1 expectation maximization [EM] cycle [OEM] method, the marginal maximum likelihood estimate with multiple EM cycles [MEM] method, and M. L. Stocking's Method B) in terms of item parameter recovery when the item responses to the pretest items in the pool are sparse. Simulations of computerized adaptive tests were used to evaluate the results yielded by the three methods. The MEM method produced the smallest average total error in parameter estimation, and the OEM method yielded the largest total error (PsycINFO Database Record (c) 2005 APA )10aComputer Assisted Testing10aEducational Measurement10aItem Response Theory10aMaximum Likelihood10aMethodology10aScaling (Testing)10aStatistical Data1 aBan, J-C1 aHanson, B A1 aYi, Q1 aHarris, D J uhttp://www.iacat.org/content/data-sparseness-and-line-pretest-item-calibration-scaling-methods-cat02894nas a2200349 4500008004100000245008300041210006900124260000800193300001100201490000700212520176600219653003001985653002802015653001502043653001002058653000902068653002202077653001102099653001902110653001102129653000902140653001602149653006202165653006102227653003302288653003602321653003102357653002602388100001402414700001602428856010002444 2002 eng d00aDevelopment of an index of physical functional health status in rehabilitation0 aDevelopment of an index of physical functional health status in  cMay a655-650 v833 aOBJECTIVE: To describe (1) the development of an index of physical functional health status (FHS) and (2) its hierarchical structure, unidimensionality, reproducibility of item calibrations, and practical application. DESIGN: Rasch analysis of existing data sets. SETTING: A total of 715 acute, orthopedic outpatient centers and 62 long-term care facilities in 41 states participating with Focus On Therapeutic Outcomes, Inc. PATIENTS: A convenience sample of 92,343 patients (40% male; mean age +/- standard deviation [SD], 48+/-17y; range, 14-99y) seeking rehabilitation between 1993 and 1999. INTERVENTIONS: Not applicable. MAIN OUTCOME MEASURES: Patients completed self-report health status surveys at admission and discharge. The Medical Outcomes Study 36-Item Short-Form Health Survey's physical functioning scale (PF-10) is the foundation of the physical FHS. The Oswestry Low Back Pain Disability Questionnaire, Neck Disability Index, Lysholm Knee Questionnaire, items pertinent to patients with upper-extremity impairments, and items pertinent to patients with more involved neuromusculoskeletal impairments were cocalibrated into the PF-10. RESULTS: The final FHS item bank contained 36 items (patient separation, 2.3; root mean square measurement error, 5.9; mean square +/- SD infit, 0.9+/-0.5; outfit, 0.9+/-0.9). Analyses supported empirical item hierarchy, unidimensionality, reproducibility of item calibrations, and content and construct validity of the FHS-36. CONCLUSIONS: Results support the reliability and validity of FHS-36 measures in the present sample. Analyses show the potential for a dynamic, computer-controlled, adaptive survey for FHS assessment applicable for group analysis and clinical decision making for individual patients.10a*Health Status Indicators10a*Rehabilitation Centers10aAdolescent10aAdult10aAged10aAged, 80 and over10aFemale10aHealth Surveys10aHumans10aMale10aMiddle Aged10aMusculoskeletal Diseases/*physiopathology/*rehabilitation10aNervous System Diseases/*physiopathology/*rehabilitation10aPhysical Fitness/*physiology10aRecovery of Function/physiology10aReproducibility of Results10aRetrospective Studies1 aHart, D L1 aWright, B D uhttp://www.iacat.org/content/development-index-physical-functional-health-status-rehabilitation01310nas a2200169 4500008004100000245009500041210006900136300001200205490000700217520070700224653003400931100001400965700001600979700001600995700001701011856011201028 2002 eng d00aEvaluation of selection procedures for computerized adaptive testing with polytomous items0 aEvaluation of selection procedures for computerized adaptive tes a393-4110 v263 aIn the present study, a procedure that has been used to select dichotomous items in computerized adaptive testing was applied to polytomous items. This procedure was designed to select the item with maximum weighted information. In a simulation study, the item information function was integrated over a fixed interval of ability values and the item with the maximum area was selected. This maximum interval information item selection procedure was compared to a maximum point information item selection procedure. Substantial differences between the two item selection procedures were not found when computerized adaptive tests were evaluated on bias and the root mean square of the ability estimate. 10acomputerized adaptive testing1 aRijn, P W1 aEggen, Theo1 aHemker, B T1 aSanders, P F uhttp://www.iacat.org/content/evaluation-selection-procedures-computerized-adaptive-testing-polytomous-items00547nas a2200145 4500008004100000245009500041210006900136300001200205490000700217100001400224700001600238700001600254700001700270856011400287 2002 eng d00aEvaluation of selection procedures for computerized adaptive testing with polytomous items0 aEvaluation of selection procedures for computerized adaptive tes a393-4110 v261 aRijn, P W1 aEggen, Theo1 aHemker, B T1 aSanders, P F uhttp://www.iacat.org/content/evaluation-selection-procedures-computerized-adaptive-testing-polytomous-items-000479nas a2200097 4500008004100000245011200041210006900153260001900222100001800241856012200259 2002 eng d00aImpact of item quality and item bank size on the psychometric quality of computer-based credentialing exams0 aImpact of item quality and item bank size on the psychometric qu aNew Orleans LA1 aHambleton, RK uhttp://www.iacat.org/content/impact-item-quality-and-item-bank-size-psychometric-quality-computer-based-credentialing00553nas a2200121 4500008004100000245013500041210006900176260001900245100001800264700001400282700001700296856011800313 2002 eng d00aImpact of selected factors on the psychometric quality of credentialing examinations administered with a sequential testlet design0 aImpact of selected factors on the psychometric quality of creden aNew Orleans LA1 aHambleton, RK1 aJodoin, M1 aZenisky, A L uhttp://www.iacat.org/content/impact-selected-factors-psychometric-quality-credentialing-examinations-administered00517nas a2200109 4500008004100000245012800041210006900169260001600238100001200254700001800266856012300284 2002 eng d00aImpact of test design, item quality and item bank size on the psychometric properties of computer-based credentialing exams0 aImpact of test design item quality and item bank size on the psy aNew Orleans1 aXing, D1 aHambleton, RK uhttp://www.iacat.org/content/impact-test-design-item-quality-and-item-bank-size-psychometric-properties-computer-based00520nas a2200133 4500008004100000245009700041210006900138260001900207100001500226700001100241700001300252700001100265856011000276 2002 eng d00aAn investigation of procedures for estimating error indexes in proficiency estimation in CAT0 ainvestigation of procedures for estimating error indexes in prof aNew Orleans LA1 aShyu, C -Y1 aFan, M1 aThompson1 aHsu, Y uhttp://www.iacat.org/content/investigation-procedures-estimating-error-indexes-proficiency-estimation-cat00578nas a2200145 4500008004100000020001400041245012100055210006900176300001200245490000700257100001500264700001900279700001300298856012100311 2002 eng d a0146-621600aItem selection in computerized adaptive testing: Improving the a-stratified design with the Sympson-Hetter algorithm0 aItem selection in computerized adaptive testing Improving the as a376-3920 v261 aLeung, C K1 aChang, Hua-Hua1 aHau, K T uhttp://www.iacat.org/content/item-selection-computerized-adaptive-testing-improving-stratified-design-sympson-hetter00554nas a2200133 4500008004100000245012100041210006900162300001200231490000700243100001500250700001900265700001300284856012300297 2002 eng d00aItem selection in computerized adaptive testing: Improving the a-stratified design with the Sympson-Hetter algorithm0 aItem selection in computerized adaptive testing Improving the as a376-3920 v261 aLeung, C-K1 aChang, Hua-Hua1 aHau, K-T uhttp://www.iacat.org/content/item-selection-computerized-adaptive-testing-improving-stratified-design-sympson-hetter-000460nas a2200121 4500008004100000245007300041210006900114260001900183100001400202700001900216700001300235856009000248 2002 eng d00aOptimum number of strata in the a-stratified adaptive testing design0 aOptimum number of strata in the astratified adaptive testing des aNew Orleans LA1 aWen, J -B1 aChang, Hua-Hua1 aHau, K-T uhttp://www.iacat.org/content/optimum-number-strata-stratified-adaptive-testing-design00459nas a2200109 4500008004100000245008600041210006900127260001900196100001500215700001600230856010300246 2002 eng d00aRedeveloping the exposure control parameters of CAT items when a pool is modified0 aRedeveloping the exposure control parameters of CAT items when a aNew Orleans LA1 aChang, S-W1 aHarris, D J uhttp://www.iacat.org/content/redeveloping-exposure-control-parameters-cat-items-when-pool-modified00492nas a2200121 4500008004100000245008700041210006900128260001500197100001400212700001900226700001700245856010800262 2001 eng d00aAdaptation of a-stratified method in variable length computerized adaptive testing0 aAdaptation of astratified method in variable length computerized aSeattle WA1 aWen, J -B1 aChang, Hua-Hua1 aHau, K -T   uhttp://www.iacat.org/content/adaptation-stratified-method-variable-length-computerized-adaptive-testing01945nas a2200169 4500008004100000245011100041210007100152300001200223490000700235520133200242100001301574700001601587700001201603700001001615700001601625856013401641 2001 eng d00aA comparative study of on line pretest item—Calibration/scaling methods in computerized adaptive testing0 acomparative study of on line pretest item—Calibrationscaling met a191-2120 v383 aThe purpose of this study was to compare and evaluate five on-line pretest item-calibration/scaling methods in computerized adaptive testing (CAT): marginal maximum likelihood estimate with one EM cycle (OEM), marginal maximum likelihood estimate with multiple EM cycles (MEM), Stocking's Method A, Stocking's Method B, and BILOG/Prior. The five methods were evaluated in terms ofitem-parameter recovery, using three different sample sizes (300, 1000 and 3000). The MEM method appeared to be the best choice among these, because it produced the smallest parameter-estimation errors for all sample size conditions. MEM and OEM are mathematically similar, although the OEM method produced larger errors. MEM also was preferable to OEM, unless the amount of timeinvolved in iterative computation is a concern. Stocking's Method B also worked very well, but it required anchor items that either would increase test lengths or require larger sample sizes depending on test administration design. Until more appropriate ways of handling sparse data are devised, the BILOG/Prior method may not be a reasonable choice for small sample sizes. Stocking's Method A hadthe largest weighted total error, as well as a theoretical weakness (i.e., treating estimated ability as true ability); thus, there appeared to be little reason to use it1 aBan, J C1 aHanson, B A1 aWang, T1 aYi, Q1 aHarris, D J uhttp://www.iacat.org/content/comparative-study-line-pretest-item%E2%80%94calibrationscaling-methods-computerized-adaptive-testing00492nas a2200133 4500008004100000245007900041210006900120260001500189100001000204700001400214700001600228700001600244856009800260 2001 eng d00aComparison of the SPRT and CMT procedures in computerized adaptive testing0 aComparison of the SPRT and CMT procedures in computerized adapti aSeattle WA1 aYi, Q1 aHanson, B1 aWidiatmo, H1 aHarris, D J uhttp://www.iacat.org/content/comparison-sprt-and-cmt-procedures-computerized-adaptive-testing00480nas a2200133 4500008004100000245007400041210006900115260001200184100001100196700001600207700001000223700001400233856009900247 2001 eng d00aData sparseness and online pretest calibration/scaling methods in CAT0 aData sparseness and online pretest calibrationscaling methods in aSeattle1 aBan, J1 aHanson, B A1 aYi, Q1 aHarris, D uhttp://www.iacat.org/content/data-sparseness-and-online-pretest-calibrationscaling-methods-cat00531nas a2200121 4500008004100000245011100041210006900152260001500221100001500236700001900251700001300270856012600283 2001 eng d00aAn examination of item selection rules by stratified CAT designs integrated with content balancing methods0 aexamination of item selection rules by stratified CAT designs in aSeattle WA1 aLeung, C-K1 aChang, Hua-Hua1 aHau, K-T uhttp://www.iacat.org/content/examination-item-selection-rules-stratified-cat-designs-integrated-content-balancing-methods02101nas a2200337 4500008004100000245014400041210006900185300001200254490000700266520096600273653002501239653003601264653002501300653001001325653003001335653001101365653001001376653000901386653003101395653003201426653003601458653003401494653002001528100001601548700001401564700001601578700001901594700001301613700001501626856012201641 2001 eng d00aAn examination of the comparative reliability, validity, and accuracy of performance ratings made using computerized adaptive rating scales0 aexamination of the comparative reliability validity and accuracy a965-9730 v863 aThis laboratory research compared the reliability, validity, and accuracy of a computerized adaptive rating scale (CARS) format and 2 relatively common and representative rating formats. The CARS is a paired-comparison rating task that uses adaptive testing principles to present pairs of scaled behavioral statements to the rater to iteratively estimate a ratee's effectiveness on 3 dimensions of contextual performance. Videotaped vignettes of 6 office workers were prepared, depicting prescripted levels of contextual performance, and 112 subjects rated these vignettes using the CARS format and one or the other competing format. Results showed 23%-37% lower standard errors of measurement for the CARS format. In addition, validity was significantly higher for the CARS format (d = .18), and Cronbach's accuracy coefficients showed significantly higher accuracy, with a median effect size of .08. The discussion focuses on possible reasons for the results.10a*Computer Simulation10a*Employee Performance Appraisal10a*Personnel Selection10aAdult10aAutomatic Data Processing10aFemale10aHuman10aMale10aReproducibility of Results10aSensitivity and Specificity10aSupport, U.S. Gov't, Non-P.H.S.10aTask Performance and Analysis10aVideo Recording1 aBorman, W C1 aBuck, D E1 aHanson, M A1 aMotowidlo, S J1 aStark, S1 aDrasgow, F uhttp://www.iacat.org/content/examination-comparative-reliability-validity-and-accuracy-performance-ratings-made-using00441nas a2200133 4500008004100000245005900041210005900100260001500159100001000174700001600184700001300200700001600213856007800229 2001 eng d00aImpact of scoring options for not reached items in CAT0 aImpact of scoring options for not reached items in CAT aSeattle WA1 aYi, Q1 aWidiatmo, H1 aBan, J-C1 aHarris, D J uhttp://www.iacat.org/content/impact-scoring-options-not-reached-items-cat00621nas a2200109 4500008004100000245018300041210006900224260006700293100001200360700001800372856012100390 2001 eng d00aImpact of several computer-based testing variables on the psychometric properties of credentialing examinations (Laboratory of Psychometric and Evaluative Research Report No 393)0 aImpact of several computerbased testing variables on the psychom aAmherst, MA: University of Massachusetts, School of Education.1 aXing, D1 aHambleton, RK uhttp://www.iacat.org/content/impact-several-computer-based-testing-variables-psychometric-properties-credentialing-000500nas a2200109 4500008004100000245011600041210006900157260001500226100001200241700001800253856011900271 2001 eng d00aImpact of several computer-based testing variables on the psychometric properties of credentialing examinations0 aImpact of several computerbased testing variables on the psychom aSeattle WA1 aXing, D1 aHambleton, RK uhttp://www.iacat.org/content/impact-several-computer-based-testing-variables-psychometric-properties-credentialing00494nas a2200121 4500008004100000245008700041210006900128260001500197100001600212700001900228700001300247856011200260 2001 eng d00aIntegrating stratification and information approaches for multiple constrained CAT0 aIntegrating stratification and information approaches for multip aSeattle WA1 aLeung, C -I1 aChang, Hua-Hua1 aHau, K-T uhttp://www.iacat.org/content/integrating-stratification-and-information-approaches-multiple-constrained-cat00574nas a2200133 4500008004100000245014400041210006900185260001500254100001500269700001100284700001300295700000900308856012300317 2001 eng d00aAn investigation of procedures for estimating error indexes in proficiency estimation in a realistic second-order equitable CAT environment0 ainvestigation of procedures for estimating error indexes in prof aSeattle WA1 aShyu, C -Y1 aFan, M1 aThompson1 aHsu. uhttp://www.iacat.org/content/investigation-procedures-estimating-error-indexes-proficiency-estimation-realistic-second01985nas a2200205 4500008004100000245010100041210006900142300001200211490000700223520124900230653001201479653002101491653003001512653001501542653001601557653004501573100001701618700001901635856012501654 2001 eng d00aItem selection in computerized adaptive testing: Should more discriminating items be used first?0 aItem selection in computerized adaptive testing Should more disc a249-2660 v383 aDuring computerized adaptive testing (CAT), items are selected continuously according to the test-taker's estimated ability. Test security has become a problem because high-discrimination items are more likely to be selected and become overexposed. So, there seems to be a tradeoff between high efficiency in ability estimations and balanced usage of items. This series of four studies addressed the dilemma by focusing on the notion of whether more or less discriminating items should be used first in CAT. The first study demonstrated that the common maximum information method with J. B. Sympson and R. D. Hetter (1985) control resulted in the use of more discriminating items first. The remaining studies showed that using items in the reverse order, as described in H. Chang and Z. Yings (1999) stratified method had potential advantages: (a) a more balanced item usage and (b) a relatively stable resultant item pool structure with easy and inexpensive management. This stratified method may have ability-estimation efficiency better than or close to that of other methods. It is argued that the judicious selection of items, as in the stratified method, is a more active control of item exposure. (PsycINFO Database Record (c) 2005 APA )10aability10aAdaptive Testing10aComputer Assisted Testing10aEstimation10aStatistical10aTest Items computerized adaptive testing1 aHau, Kit-Tai1 aChang, Hua-Hua uhttp://www.iacat.org/content/item-selection-computerized-adaptive-testing-should-more-discriminating-items-be-used-first00502nas a2200109 4500008004100000245011100041210006900152260001500221100001600236700001400252856012600266 2001 eng d00aMultidimensional adaptive testing using weighted likelihood estimation: A comparison of estimation methods0 aMultidimensional adaptive testing using weighted likelihood esti aSeattle WA1 aTseng, F -E1 aHsu, T -C uhttp://www.iacat.org/content/multidimensional-adaptive-testing-using-weighted-likelihood-estimation-comparison-estimation00587nas a2200133 4500008004100000245013700041210006900178260001500247100001800262700001700280700001600297700001700313856012300330 2001 eng d00aNearest neighbors, simple strata, and probabilistic parameters: An empirical comparison of methods for item exposure control in CATs0 aNearest neighbors simple strata and probabilistic parameters An  aSeattle WA1 aParshall, C G1 aKromrey, J D1 aHarmes, J C1 aSentovich, C uhttp://www.iacat.org/content/nearest-neighbors-simple-strata-and-probabilistic-parameters-empirical-comparison-methods00609nas a2200121 4500008004100000245017700041210006900218260002700287100001600314700001700330700001800347856012200365 2001 eng d00aOnline item parameter recalibration: Application of missing data treatments to overcome the effects of sparse data conditions in a computerized adaptive version of the MCAT0 aOnline item parameter recalibration Application of missing data  aUnpublished manuscript1 aHarmes, J C1 aKromrey, J D1 aParshall, C G uhttp://www.iacat.org/content/online-item-parameter-recalibration-application-missing-data-treatments-overcome-effects01360nas a2200205 4500008004100000245016700041210007000208300001000278490000700288520051600295653003000811653003100841653004800872100001800920700001900938700002600957700002600983700001401009856013101023 2001 eng d00aRequerimientos, aplicaciones e investigación en tests adaptativos informatizados [Requirements, applications, and investigation in computerized adaptive testing]0 aRequerimientos aplicaciones e investigación en tests adaptativos a11-280 v193 aSummarizes the main requirements and applications of computerized adaptive testing (CAT) with emphasis on the differences between CAT and conventional computerized tests. Psychometric properties of estimations based on CAT, item selection strategies, and implementation software are described. Results of CAT studies in Spanish-speaking samples are described. Implications for developing a CAT measuring the English vocabulary of Spanish-speaking students are discussed. (PsycINFO Database Record (c) 2005 APA )10aComputer Assisted Testing10aEnglish as Second Language10aPsychometrics computerized adaptive testing1 aOlea Díaz, J1 aPonsoda Gil, V1 aRevuelta Menéndez, J1 aHontangas Beltrán, P1 aAbad, F J uhttp://www.iacat.org/content/requerimientos-aplicaciones-e-investigaci%C3%B3n-en-tests-adaptativos-informatizados-requirements01591nas a2200205 4500008004100000245016500041210006900206300001200275490000700287520076900294653002101063653002601084653003001110653002501140653005101165100001301216700001701229700002101246856011801267 2001 eng d00aToepassing van een computergestuurde adaptieve testprocedure op persoonlijkheidsdata [Application of a computerised adaptive test procedure on personality data]0 aToepassing van een computergestuurde adaptieve testprocedure op  a119-1330 v563 aStudied the applicability of a computerized adaptive testing procedure to an existing personality questionnaire within the framework of item response theory. The procedure was applied to the scores of 1,143 male and female university students (mean age 21.8 yrs) in the Netherlands on the Neuroticism scale of the Amsterdam Biographical Questionnaire (G. J. Wilde, 1963). The graded response model (F. Samejima, 1969) was used. The quality of the adaptive test scores was measured based on their correlation with test scores for the entire item bank and on their correlation with scores on other scales from the personality test. The results indicate that computerized adaptive testing can be applied to personality scales. (PsycINFO Database Record (c) 2005 APA )10aAdaptive Testing10aComputer Applications10aComputer Assisted Testing10aPersonality Measures10aTest Reliability computerized adaptive testing1 aHol, A M1 aVorst, H C M1 aMellenbergh, G J uhttp://www.iacat.org/content/toepassing-van-een-computergestuurde-adaptieve-testprocedure-op-persoonlijkheidsdata00376nas a2200121 4500008004100000245004600041210004500087300001000132490001000142100001400152700001600166856007200182 2001 eng d00aValidity issues in computer-based testing0 aValidity issues in computerbased testing a16-250 v20(3)1 aHuff, K L1 aSireci, S G uhttp://www.iacat.org/content/validity-issues-computer-based-testing00450nas a2200145 4500008004100000245005800041210005400099300000900153490000700162100001700169700001500186700001200201700001400213856007700227 2000 eng d00aThe choice of item difficulty in self adapted testing0 achoice of item difficulty in self adapted testing a3-120 v161 aHontangas, P1 aPonsoda, V1 aOlea, J1 aWise, S L uhttp://www.iacat.org/content/choice-item-difficulty-self-adapted-testing01563nas a2200229 4500008004100000245006400041210006300105300001100168490000600179520083800185653002701023653001501050653001501065653004201080653001101122653002601133653002601159653003101185100001501216700001601231856008601247 2000 eng d00aComputerization and adaptive administration of the NEO PI-R0 aComputerization and adaptive administration of the NEO PIR a347-640 v73 aThis study asks, how well does an item response theory (IRT) based computerized adaptive NEO PI-R work? To explore this question, real-data simulations (N = 1,059) were used to evaluate a maximum information item selection computerized adaptive test (CAT) algorithm. Findings indicated satisfactory recovery of full-scale facet scores with the administration of around four items per facet scale. Thus, the NEO PI-R could be reduced in half with little loss in precision by CAT administration. However, results also indicated that the CAT algorithm was not necessary. We found that for many scales, administering the "best" four items per facet scale would have produced similar results. In the conclusion, we discuss the future of computerized personality assessment and describe the role IRT methods might play in such assessments.10a*Personality Inventory10aAlgorithms10aCalifornia10aDiagnosis, Computer-Assisted/*methods10aHumans10aModels, Psychological10aPsychometrics/methods10aReproducibility of Results1 aReise, S P1 aHenson, J M uhttp://www.iacat.org/content/computerization-and-adaptive-administration-neo-pi-r00586nas a2200133 4500008004100000245009000041210006900131260007900200100001600279700001600295700001800311700001400329856010900343 2000 eng d00aComputerized adaptive rating scales (CARS): Development and evaluation of the concept0 aComputerized adaptive rating scales CARS Development and evaluat a(Institute Rep No. 350). Tampa FL: Personnel Decisions Research Institute.1 aBorman, W C1 aHanson, M A1 aKubisiak, U C1 aBuck, D E uhttp://www.iacat.org/content/computerized-adaptive-rating-scales-cars-development-and-evaluation-concept00473nas a2200121 4500008004100000245007400041210006900115260002000184100001500204700001900219700001300238856010000251 2000 eng d00aContent balancing in stratified computerized adaptive testing designs0 aContent balancing in stratified computerized adaptive testing de aNew Orleans, LA1 aLeung, C-K1 aChang, Hua-Hua1 aHau, K-T uhttp://www.iacat.org/content/content-balancing-stratified-computerized-adaptive-testing-designs00475nas a2200133 4500008004100000245007200041210006900113260001900182100001300201700001200214700001000226700001600236856008900252 2000 eng d00aEffects of nonequivalence of item pools on ability estimates in CAT0 aEffects of nonequivalence of item pools on ability estimates in  aNew Orleans LA1 aBan, J C1 aWang, T1 aYi, Q1 aHarris, D J uhttp://www.iacat.org/content/effects-nonequivalence-item-pools-ability-estimates-cat00716nas a2200193 4500008004100000245008400041210006900125300001400194490000700208653003000215653001100245653002500256653001600281653005500297653002200352653002300374100001800397856010700415 2000 eng d00aEmergence of item response modeling in instrument development and data analysis0 aEmergence of item response modeling in instrument development an aII60-II650 v3810aComputer Assisted Testing10aHealth10aItem Response Theory10aMeasurement10aStatistical Validity computerized adaptive testing10aTest Construction10aTreatment Outcomes1 aHambleton, RK uhttp://www.iacat.org/content/emergence-item-response-modeling-instrument-development-and-data-analysis00571nas a2200133 4500008004100000245012200041210006900163260003100232100001600263700001600279700001400295700001500309856011300324 2000 eng d00aEstimating Item Parameters from Classical Indices for Item Pool Development with a Computerized Classification Test. 0 aEstimating Item Parameters from Classical Indices for Item Pool  aIowa City, IowabACT, Inc.1 aHuang, C -Y1 aKalohn, J C1 aLin, C -J1 aSpray, J A uhttp://www.iacat.org/content/estimating-item-parameters-classical-indices-item-pool-development-computerized00589nas a2200133 4500008004100000245014500041210006900186260002600255100001600281700001600297700001400313700001300327856011500340 2000 eng d00aEstimating item parameters from classical indices for item pool development with a computerized classification test (Research Report 2000-4)0 aEstimating item parameters from classical indices for item pool  aIowa City IA: ACT Inc1 aHuang, C -Y1 aKalohn, J C1 aLin, C -J1 aSpray, J uhttp://www.iacat.org/content/estimating-item-parameters-classical-indices-item-pool-development-computerized-100529nas a2200133 4500008004100000245010200041210006900143300001000212490000700222100001600229700001600245700001700261856011700278 2000 eng d00aItem exposure control in computer-adaptive testing: The use of freezing to augment stratification0 aItem exposure control in computeradaptive testing The use of fre a28-520 v401 aParshall, C1 aHarmes, J C1 aKromrey, J D uhttp://www.iacat.org/content/item-exposure-control-computer-adaptive-testing-use-freezing-augment-stratification01774nas a2200289 4500008004100000245007700041210006900118300001400187490000700201520080000208653002501008653003101033653003701064653003801101653001901139653001001158653002701168653004601195653002001241653002801261653003201289653001801321100001401339700001701353700001501370856009901385 2000 eng d00aItem response theory and health outcomes measurement in the 21st century0 aItem response theory and health outcomes measurement in the 21st aII28-II420 v383 aItem response theory (IRT) has a number of potential advantages over classical test theory in assessing self-reported health outcomes. IRT models yield invariant item and latent trait estimates (within a linear transformation), standard errors conditional on trait level, and trait estimates anchored to item content. IRT also facilitates evaluation of differential item functioning, inclusion of items with different response formats in the same scale, and assessment of person fit and is ideally suited for implementing computer adaptive testing. Finally, IRT methods can be helpful in developing better health outcome measures and in assessing change over time. These issues are reviewed, along with a discussion of some of the methodological and practical challenges in applying IRT methods.10a*Models, Statistical10aActivities of Daily Living10aData Interpretation, Statistical10aHealth Services Research/*methods10aHealth Surveys10aHuman10aMathematical Computing10aOutcome Assessment (Health Care)/*methods10aResearch Design10aSupport, Non-U.S. Gov't10aSupport, U.S. Gov't, P.H.S.10aUnited States1 aHays, R D1 aMorales, L S1 aReise, S P uhttp://www.iacat.org/content/item-response-theory-and-health-outcomes-measurement-21st-century00555nas a2200133 4500008004100000245011800041210006900159300001000228490000700238100001700245700002100262700001500283856012300298 2000 eng d00aLimiting answer review and change on computerized adaptive vocabulary tests: Psychometric and attitudinal results0 aLimiting answer review and change on computerized adaptive vocab a21-380 v371 aVispoel, W P1 aHendrickson, A B1 aBleiler, T uhttp://www.iacat.org/content/limiting-answer-review-and-change-computerized-adaptive-vocabulary-tests-psychometric-and00692nas a2200169 4500008004100000020001400041245015800055210006900213300001200282490000600294653003400300100001700334700001500351700001200366700001400378856013000392 2000 eng d a1575-910500aLos tests adaptativos informatizados en la frontera del siglo XXI: Una revisión [Computerized adaptive tests at the turn of the 21st century: A review]0 aLos tests adaptativos informatizados en la frontera del siglo XX a183-2160 v210acomputerized adaptive testing1 aHontangas, P1 aPonsoda, V1 aOlea, J1 aAbad, F J uhttp://www.iacat.org/content/los-tests-adaptativos-informatizados-en-la-frontera-del-siglo-xxi-una-revisi%C3%B3n-computerized02579nas a2200145 4500008004100000245008100041210006900122300001000191490000700201520207600208100001502284700001602299700002002315856009802335 2000 eng d00aA real data simulation of computerized adaptive administration of the MMPI-A0 areal data simulation of computerized adaptive administration of  a83-960 v163 aA real data simulation of computerized adaptive administration of the Minnesota Multiphasic Inventory-Adolescent (MMPI-A) was conducted using item responses from three groups of participants. The first group included 196 adolescents (age range 14-18) tested at a midwestern residential treatment facility for adolescents. The second group was the normative sample used in the standardization of the MMPI-A (Butcher, Williams, Graham, Archer, Tellegen, Ben-Porath, & Kaemmer, 1992. Minnesota Multiphasic Inventory-Adolescent (MMPI-A): manual for administration, scoring, and interpretation. Minneapolis: University of Minnesota Press.). The third group was the clinical sample: used in the validation of the MMPI-A (Williams & Butcher, 1989. An MMPI study of adolescents: I. Empirical validation of the study's scales. Personality assessment, 1, 251-259.). The MMPI-A data for each group of participants were run through a modified version of the MMPI-2 adaptive testing computer program (Roper, Ben-Porath & Butcher, 1995. Comparability and validity of computerized adaptive testing with the MMPI-2. Journal of Personality Assessment, 65, 358-371.). To determine the optimal amount of item savings, each group's MMPI-A item responses were used to simulate three different orderings of the items: (1) from least to most frequently endorsed in the keyed direction; (2) from least to most frequently endorsed in the keyed direction with the first 120 items rearranged into their booklet order; and (3) all items in booklet order. The mean number of items administered for each group was computed for both classification and full- scale elevations for T-score cut-off values of 60 and 65. Substantial item administration savings were achieved for all three groups, and the mean number of items saved ranged from 50 items (10.7% of the administered items) to 123 items (26.4% of the administered items), depending upon the T-score cut-off, classification method (i.e. classification only or full-scale elevation), and group. (C) 2000 Elsevier Science Ltd. All rights reserved.1 aFobey, J D1 aHandel, R W1 aBen-Porath, Y S uhttp://www.iacat.org/content/real-data-simulation-computerized-adaptive-administration-mmpi-000492nas a2200133 4500008004100000245008100041210006900122300001000191490000700201100001600208700001600224700002000240856009800260 2000 eng d00aA real data simulation of computerized adaptive administration of the MMPI-A0 areal data simulation of computerized adaptive administration of  a83-960 v161 aForbey, J D1 aHandel, R W1 aBen-Porath, Y S uhttp://www.iacat.org/content/real-data-simulation-computerized-adaptive-administration-mmpi-100594nas a2200133 4500008004100000245013300041210006900174260003400243100000900277700001600286700001600302700001700318856012500335 2000 eng d00aA selection procedure for polytomous items in computerized adaptive testing (Measurement and Research Department Reports 2000-5)0 aselection procedure for polytomous items in computerized adaptiv aArnhem, The Netherlands: Cito1 aRijn1 aEggen, Theo1 aHemker, B T1 aSanders, P F uhttp://www.iacat.org/content/selection-procedure-polytomous-items-computerized-adaptive-testing-measurement-and-research00496nas a2200121 4500008004100000245008600041210006900127260002100196100001500217700001900232700001300251856011000264 2000 eng d00aSolving complex constraints in a-stratified computerized adaptive testing designs0 aSolving complex constraints in astratified computerized adaptive aNew Orleans, USA1 aLeung, C-K1 aChang, Hua-Hua1 aHau, K-T uhttp://www.iacat.org/content/solving-complex-constraints-stratified-computerized-adaptive-testing-designs00560nas a2200121 4500008004100000245013100041210006900172260001900241100001800260700001700278700001700295856012600312 2000 eng d00aSufficient simplicity or comprehensive complexity? A comparison of probabilitic and stratification methods of exposure control0 aSufficient simplicity or comprehensive complexity A comparison o aNew Orleans LA1 aParshall, C G1 aKromrey, J D1 aHogarty, K Y uhttp://www.iacat.org/content/sufficient-simplicity-or-comprehensive-complexity-comparison-probabilitic-and-stratification00506nas a2200145 4500008004100000245007100041210006900112260002100181100001200202700001000214700001300224700001600237700001600253856009100269 1999 eng d00aAdjusting "scores" from a CAT following successful item challenges0 aAdjusting scores from a CAT following successful item challenges aMontreal, Canada1 aWang, T1 aYi, Q1 aBan, J C1 aHarris, D J1 aHanson, B A uhttp://www.iacat.org/content/adjusting-scores-cat-following-successful-item-challenges00427nas a2200109 4500008004100000245007800041210006900119300001000188490000700198100001600205856009600221 1999 eng d00aBenefits from computerized adaptive testing as seen in simulation studies0 aBenefits from computerized adaptive testing as seen in simulatio a91-980 v151 aHornke, L F uhttp://www.iacat.org/content/benefits-computerized-adaptive-testing-seen-simulation-studies00494nas a2200109 4500008004100000245010000041210006900141260002000210100001700230700001800247856011900265 1999 eng d00aA comparative study of ability estimates from computer-adaptive testing and multi-stage testing0 acomparative study of ability estimates from computeradaptive tes aMontreal Canada1 aPatsula, L N1 aHambleton, RK uhttp://www.iacat.org/content/comparative-study-ability-estimates-computer-adaptive-testing-and-multi-stage-testing00478nas a2200133 4500008004100000245007500041210006900116300001200185490000700197100001600204700002000220700001400240856009000254 1999 eng d00aComputerized adaptive assessment with the MMPI-2 in a clinical setting0 aComputerized adaptive assessment with the MMPI2 in a clinical se a369-3800 v111 aHandel, R W1 aBen-Porath, Y S1 aWatt, M E uhttp://www.iacat.org/content/computerized-adaptive-assessment-mmpi-2-clinical-setting00521nas a2200109 4500008004100000245006300041210006300104260012100167100001900288700001600307856008800323 1999 eng d00aDeveloping computerized adaptive tests for school children0 aDeveloping computerized adaptive tests for school children aF. Drasgow and J. B. Olson-Buchanan (Eds.), Innovations in computerized assessment (pp. 93-115). Mahwah NJ: Erlbaum.1 aKingsbury, G G1 aHouser, R L uhttp://www.iacat.org/content/developing-computerized-adaptive-tests-school-children00661nas a2200133 4500008004100000245012100041210006900162260010800231100001600339700001700355700001600372700001500388856012400403 1999 eng d00aThe development of a computerized adaptive selection system for computer programmers in a financial services company0 adevelopment of a computerized adaptive selection system for comp aF. Drasgow and J. B. Olsen (Eds.), Innvoations in computerized assessment (p. 7-33). Mahwah NJ Erlbaum.1 aZickar, M J1 aOverton, R C1 aTaylor, L R1 aHarms, H J uhttp://www.iacat.org/content/development-computerized-adaptive-selection-system-computer-programmers-financial-services00446nas a2200121 4500008004100000245006400041210006100105260002100166100001500187700001900202700001300221856009000234 1999 eng d00aAn enhanced stratified computerized adaptive testing design0 aenhanced stratified computerized adaptive testing design aMontreal, Canada1 aLeung, C-K1 aChang, Hua-Hua1 aHau, K-T uhttp://www.iacat.org/content/enhanced-stratified-computerized-adaptive-testing-design00485nas a2200121 4500008004100000245008600041210006900127260001600196100001600212700001500228700001500243856010500258 1999 eng d00aItem exposure in adaptive tests: An empirical investigation of control strategies0 aItem exposure in adaptive tests An empirical investigation of co aLawrence KS1 aParshall, C1 aHogarty, K1 aKromrey, J uhttp://www.iacat.org/content/item-exposure-adaptive-tests-empirical-investigation-control-strategies00473nas a2200097 4500008004100000245008900041210006900130260004700199100001900246856011000265 1999 eng d00aItem nonresponse: Occurrence, causes and imputation of missing answers to test items0 aItem nonresponse Occurrence causes and imputation of missing ans a(M and T Series No 32). Leiden: DSWO Press1 aHuisman, J M E uhttp://www.iacat.org/content/item-nonresponse-occurrence-causes-and-imputation-missing-answers-test-items00540nas a2200121 4500008004100000245012100041210006900162260001700231100001500248700001900263700001300282856012300295 1999 eng d00aItem selection in computerized adaptive testing: improving the a-stratified design with the Sympson-Hetter algorithm0 aItem selection in computerized adaptive testing improving the as aMontreal, CA1 aLeung, C-K1 aChang, Hua-Hua1 aHau, K-T uhttp://www.iacat.org/content/item-selection-computerized-adaptive-testing-improving-stratified-design-sympson-hetter-100627nas a2200157 4500008004100000245011800041210006900159260002100228100001700249700001900266700001500285700001600300700001500316700001300331856012500344 1999 eng d00aLimiting answer review and change on computerized adaptive vocabulary tests: Psychometric and attitudinal results0 aLimiting answer review and change on computerized adaptive vocab aMontreal, Canada1 aVispoel, W P1 aHendrickson, A1 aBleiler, T1 aWidiatmo, H1 aShrairi, S1 aIhrig, D uhttp://www.iacat.org/content/limiting-answer-review-and-change-computerized-adaptive-vocabulary-tests-psychometric-and-000467nas a2200133 4500008004100000245007000041210006900111300001200180490000700192100001200199700001600211700001600227856009000243 1999 eng d00aReducing bias in CAT trait estimation: A comparison of approaches0 aReducing bias in CAT trait estimation A comparison of approaches a263-2780 v231 aWang, T1 aHanson, B H1 aLau, C -M H uhttp://www.iacat.org/content/reducing-bias-cat-trait-estimation-comparison-approaches00481nas a2200109 4500008004100000245009400041210006900135260001700204100001600221700001600237856011800253 1999 eng d00aReducing item exposure without reducing precision (much) in computerized adaptive testing0 aReducing item exposure without reducing precision much in comput aMontreal, CA1 aHolmes, R M1 aSegall, D O uhttp://www.iacat.org/content/reducing-item-exposure-without-reducing-precision-much-computerized-adaptive-testing00324nas a2200121 4500008004100000245002500041210002500066260001400091100001100105700001800116700001400134856005400148 1998 eng d00aCAT item calibration0 aCAT item calibration aSan Diego1 aHsu, Y1 aThompson, T D1 aChen, W-H uhttp://www.iacat.org/content/cat-item-calibration00544nas a2200133 4500008004100000245012500041210006900166300001200235490000700247100001200254700001100266700001400277856011900291 1998 eng d00aA comparison of maximum likelihood estimation and expected a posteriori estimation in CAT using the partial credit model0 acomparison of maximum likelihood estimation and expected a poste a569-5950 v581 aChen, S1 aHou, L1 aDodd, B G uhttp://www.iacat.org/content/comparison-maximum-likelihood-estimation-and-expected-posteriori-estimation-cat-using00557nas a2200157 4500008004100000245007600041210006900117260001400186100001600200700001600216700002000232700001500252700001400267700001800281856010000299 1998 eng d00aComputerized adaptive rating scales that measure contextual performance0 aComputerized adaptive rating scales that measure contextual perf aDallas TX1 aBorman, W C1 aHanson, M A1 aMontowidlo, S J1 aDrasgow, F1 aFoster, L1 aKubisiak, U C uhttp://www.iacat.org/content/computerized-adaptive-rating-scales-measure-contextual-performance01753nas a2200217 4500008004100000245015600041210006900197300001100266490000600277520090700283653004001190653002201230653002401252653002301276653003701299653001001336653002401346653002701370100001801397856012001415 1998 eng d00aThe effect of item pool restriction on the precision of ability measurement for a Rasch-based CAT: comparisons to traditional fixed length examinations0 aeffect of item pool restriction on the precision of ability meas a97-1220 v23 aThis paper describes a method for examining the precision of a computerized adaptive test with a limited item pool. Standard errors of measurement ascertained in the testing of simulees with a CAT using a restricted pool were compared to the results obtained in a live paper-and-pencil achievement testing of 4494 nursing students on four versions of an examination of calculations of drug administration. CAT measures of precision were considered when the simulated examine pools were uniform and normal. Precision indices were also considered in terms of the number of CAT items required to reach the precision of the traditional tests. Results suggest that regardless of the size of the item pool, CAT provides greater precision in measurement with a smaller number of items administered even when the choice of items is limited but fails to achieve equiprecision along the entire ability continuum.10a*Decision Making, Computer-Assisted10aComparative Study10aComputer Simulation10aEducation, Nursing10aEducational Measurement/*methods10aHuman10aModels, Statistical10aPsychometrics/*methods1 aHalkitis, P N uhttp://www.iacat.org/content/effect-item-pool-restriction-precision-ability-measurement-rasch-based-cat-comparisons00465nas a2200121 4500008004100000245007700041210006900118260001400187100001200201700001100213700001600224856010300240 1998 eng d00aEssentially unbiased Bayesian estimates in computerized adaptive testing0 aEssentially unbiased Bayesian estimates in computerized adaptive aSan Diego1 aWang, T1 aLau, C1 aHanson, B A uhttp://www.iacat.org/content/essentially-unbiased-bayesian-estimates-computerized-adaptive-testing00569nas a2200097 4500008004100000245020300041210006900244100001300313700001900326856012600345 1998 eng d00aItem selection in computerized adaptive testing: Should more discriminating items be used first? Paper presented at the annual meeting of the American Educational Research Association, San Diego, CA0 aItem selection in computerized adaptive testing Should more disc1 aHau, K T1 aChang, Hua-Hua uhttp://www.iacat.org/content/item-selection-computerized-adaptive-testing-should-more-discriminating-items-be-used-firs-100510nas a2200121 4500008004100000245010100041210006900142300001200211490000700223100001300230700001900243856012600262 1998 eng d00aItem selection in computerized adaptive testing: Should more discriminating items be used first?0 aItem selection in computerized adaptive testing Should more disc a249-2660 v381 aHau, K T1 aChang, Hua-Hua uhttp://www.iacat.org/content/item-selection-computerized-adaptive-testing-should-more-discriminating-items-be-used-firs-000395nas a2200145 4500008004100000245003300041210003300074300001200107490000700119100001700126700001500143700001600158700001600174856005900190 1997 eng d00aAdapting to adaptive testing0 aAdapting to adaptive testing a171-1850 v501 aOverton, R C1 aHarms, H J1 aTaylor, L R1 aZickar, M J uhttp://www.iacat.org/content/adapting-adaptive-testing00521nas a2200121 4500008004100000245010200041210006900143260001800212100001500230700001800245700001600263856012000279 1997 eng d00aCalibration of CAT items administered online for classification: Assumption of local independence0 aCalibration of CAT items administered online for classification  aGatlinburg TN1 aSpray, J A1 aParshall, C G1 aHuang, C -H uhttp://www.iacat.org/content/calibration-cat-items-administered-online-classification-assumption-local-independence00491nas a2200109 4500008004100000245010400041210006900145100001600214700002000230700001200250856011900262 1997 eng d00aComparability and validity of computerized adaptive testing with the MMPI-2 using a clinical sample0 aComparability and validity of computerized adaptive testing with1 aHandel, R W1 aBen-Porath, Y S1 aWatt, M uhttp://www.iacat.org/content/comparability-and-validity-computerized-adaptive-testing-mmpi-2-using-clinical-sample01799nas a2200169 4500008004100000245014100041210006900182300001200251490000700263520113700270653003401407100001401441700001301455700002101468700001401489856012601503 1997 eng d00aThe effect of population distribution and method of theta estimation on computerized adaptive testing (CAT) using the rating scale model0 aeffect of population distribution and method of theta estimation a422-4390 v573 aInvestigated the effect of population distribution on maximum likelihood estimation (MLE) and expected a posteriori estimation (EAP) in a simulation study of computerized adaptive testing (CAT) based on D. Andrich's (1978) rating scale model. Comparisons were made among MLE and EAP with a normal prior distribution and EAP with a uniform prior distribution within 2 data sets: one generated using a normal trait distribution and the other using a negatively skewed trait distribution. Descriptive statistics, correlations, scattergrams, and accuracy indices were used to compare the different methods of trait estimation. The EAP estimation with a normal prior or uniform prior yielded results similar to those obtained with MLE, even though the prior did not match the underlying trait distribution. An additional simulation study based on real data suggested that more work is needed to determine the optimal number of quadrature points for EAP in CAT based on the rating scale model. The choice between MLE and EAP for particular measurement situations is discussed. (PsycINFO Database Record (c) 2003 APA, all rights reserved).10acomputerized adaptive testing1 aChen, S-K1 aHou, L Y1 aFitzpatrick, S J1 aDodd, B G uhttp://www.iacat.org/content/effect-population-distribution-and-method-theta-estimation-computerized-adaptive-testing-cat00596nas a2200145 4500008004100000245014200041210006900183300001200252490000700264100001200271700001100283700002100294700001200315856012300327 1997 eng d00aThe effect of population distribution and methods of theta estimation on computerized adaptive testing (CAT) using the rating scale model0 aeffect of population distribution and methods of theta estimatio a422-4390 v571 aChen, S1 aHou, L1 aFitzpatrick, S J1 aDodd, B uhttp://www.iacat.org/content/effect-population-distribution-and-methods-theta-estimation-computerized-adaptive-testing00620nas a2200121 4500008004100000245007200041210006900113260017000182100001600352700001600368700001600384856009800400 1997 eng d00aEvaluating item calibration medium in computerized adaptive testing0 aEvaluating item calibration medium in computerized adaptive test aW.A. Sands, B.K. Waters and J.R. McBride, Computerized adaptive testing: From inquiry to operation (pp. 161-168). Washington, DC: American Psychological Association.1 aHetter, R D1 aSegall, D O1 aBloxom, B M uhttp://www.iacat.org/content/evaluating-item-calibration-medium-computerized-adaptive-testing00922nas a2200145 4500008004100000245003900041210003800080260006100118300001200179520047000191100001600661700001700677700001700694856006500711 1997 eng d00aItem exposure control in CAT-ASVAB0 aItem exposure control in CATASVAB aWashington D.C., USAbAmerican Psychological Association a141-1443 aDescribes the method used to control item exposure in computerized adaptive testing-Armed Services Vocational Aptitude Battery (CAT-ASVAB). The method described was developed specifically to ensure that CAT-ASVAB items were expose no more often than the items in the printers ASVAB's alternate forms, ensuring that CAT ASVAB is nor more vulnerable than printed ASVAB forms to comprise from item exposure. (PsycINFO Database Record (c) 2010 APA, all rights reserved)1 aHetter, R D1 aSympson, J B1 aMcBride, J R uhttp://www.iacat.org/content/item-exposure-control-cat-asvab00543nas a2200121 4500008004100000245004100041210004100082260018000123100001600303700001600319700001600335856007000351 1997 eng d00aItem pool development and evaluation0 aItem pool development and evaluation aW. A. Sands, B. K. Waters, and J. R. McBride (Eds.), Computerized adaptive testing: From inquiry to operation (pp. 117-130). Washington DC: American Psychological Association.1 aSegall, D O1 aMoreno, K E1 aHetter, D H uhttp://www.iacat.org/content/item-pool-development-and-evaluation00514nas a2200109 4500008004100000245004600041210004600087260016400133100001600297700001600313856007500329 1997 eng d00aPolicy and program management perspective0 aPolicy and program management perspective aW.A. Sands, B.K. Waters, and J.R. McBride (Eds.), Computerized adaptive testing: From inquiry to operation. Washington, DC: American Psychological Association.1 aMartin, C J1 aHoshaw, C R uhttp://www.iacat.org/content/policy-and-program-management-perspective00664nas a2200121 4500008004100000245009200041210006900133260017800202100001700380700001600397700001600413856011300429 1997 eng d00aPreliminary psychometric research for CAT-ASVAB: Selecting an adaptive testing strategy0 aPreliminary psychometric research for CATASVAB Selecting an adap aW. A. Sands, B. K. Waters, and J. R. McBride (Eds.), Computerized adaptive testing: From inquiry to operation (pp. 83-95). Washington DC: American Psychological Association.1 aMcBride, J R1 aWetzel, C D1 aHetter, R D uhttp://www.iacat.org/content/preliminary-psychometric-research-cat-asvab-selecting-adaptive-testing-strategy00459nas a2200109 4500008004100000245008700041210006900128260001500197100001400212700001500226856010800241 1997 eng d00aPsychometric mode effects and fit issues with respect to item difficulty estimates0 aPsychometric mode effects and fit issues with respect to item di aChicago IL1 aHadidi, A1 aLuecht, RM uhttp://www.iacat.org/content/psychometric-mode-effects-and-fit-issues-respect-item-difficulty-estimates00613nas a2200133 4500008004100000245005600041210005500097260018200152100001600334700001600350700001600366700001600382856008100398 1997 eng d00aPsychometric procedures for administering CAT-ASVAB0 aPsychometric procedures for administering CATASVAB aW. A. Sands, B. K. Waters, and J. R. McBride (Eds.), Computerized adaptive testing: From inquiry to operation (pp. 131-140). Washington D.C.: American Psychological Association.1 aSegall, D O1 aMoreno, K E1 aBloxom, B M1 aHetter, R D uhttp://www.iacat.org/content/psychometric-procedures-administering-cat-asvab00608nas a2200133 4500008004100000245014700041210006900188260002600257100001500283700002200298700001600320700001200336856012600348 1997 eng d00aUnidimensional approximations for a computerized adaptive test when the item pool and latent space are multidimensional (Research Report 97-5)0 aUnidimensional approximations for a computerized adaptive test w aIowa City IA: ACT Inc1 aSpray, J A1 aAbdel-Fattah, A A1 aHuang, C -Y1 aLau, CA uhttp://www.iacat.org/content/unidimensional-approximations-computerized-adaptive-test-when-item-pool-and-latent-space-are00717nas a2200121 4500008004100000245008100041210006900122260025000191100001700441700001800458700001600476856010300492 1996 eng d00aAdaptive assessment and training using the neighbourhood of knowledge states0 aAdaptive assessment and training using the neighbourhood of know aFrasson, C. and Gauthier, G. and Lesgold, A. (eds.) Intelligent Tutoring Systems, Third International Conference, ITS'96, Montral, Canada, June 1996 Proceedings. Lecture Notes in Computer Science 1086. Berlin Heidelberg: Springer-Verlag 578-587.1 aDowling, C E1 aHockemeyer, C1 aLudwig, A H uhttp://www.iacat.org/content/adaptive-assessment-and-training-using-neighbourhood-knowledge-states00704nas a2200121 4500008004100000245007200041210006900113260025200182100001700434700001500451700001500466856010100481 1996 eng d00aAdaptive assessment using granularity hierarchies and Bayesian nets0 aAdaptive assessment using granularity hierarchies and Bayesian n aFrasson, C. and Gauthier, G. and Lesgold, A. (Eds.) Intelligent Tutoring Systems, Third International Conference, ITS'96, Montréal, Canada, June 1996 Proceedings. Lecture Notes in Computer Science 1086. Berlin Heidelberg: Springer-Verlag 569-577.1 aCollins, J A1 aGreer, J E1 aHuang, S X uhttp://www.iacat.org/content/adaptive-assessment-using-granularity-hierarchies-and-bayesian-nets00672nas a2200097 4500008004100000245008600041210006900127260025400196100001500450856010900465 1996 eng d00aA content-balanced adaptive testing algorithm for computer-based training systems0 acontentbalanced adaptive testing algorithm for computerbased tra aFrasson, C. and Gauthier, G. and Lesgold, A. (Eds.), Intelligent Tutoring Systems, Third International Conference, ITS'96, Montr�al, Canada, June 1996 Proceedings. Lecture Notes in Computer Science 1086. Berlin Heidelberg: Springer-Verlag 306-314.1 aHuang, S X uhttp://www.iacat.org/content/content-balanced-adaptive-testing-algorithm-computer-based-training-systems00584nas a2200133 4500008004100000245013900041210006900180260001600249100001100265700001200276700001700288700002100305856012400326 1996 eng d00aThe effects of methods of theta estimation, prior distribution, and number of quadrature points on CAT using the graded response model0 aeffects of methods of theta estimation prior distribution and nu aNew York NY1 aHou, L1 aChen, S1 aG., Dodd., B1 aFitzpatrick, S J uhttp://www.iacat.org/content/effects-methods-theta-estimation-prior-distribution-and-number-quadrature-points-cat-using00543nas a2200121 4500008004100000245012100041210006900162260001300231100002000244700001800264700001400282856012500296 1996 eng d00aEffects of randomesque item selection on CAT item exposure rates and proficiency estimation under 1- and 2-PL models0 aEffects of randomesque item selection on CAT item exposure rates aNew York1 aFeatherman, C M1 aSubhiyah, R G1 aHadadi, A uhttp://www.iacat.org/content/effects-randomesque-item-selection-cat-item-exposure-rates-and-proficiency-estimation-under00473nas a2200121 4500008004100000245007400041210006900115260001600184100001500200700001400215700001900229856010300248 1996 eng d00aHeuristic-based CAT: Balancing item information, content and exposure0 aHeuristicbased CAT Balancing item information content and exposu aNew York NY1 aLuecht, RM1 aHadadi, A1 aNungester, R J uhttp://www.iacat.org/content/heuristic-based-cat-balancing-item-information-content-and-exposure-000472nas a2200121 4500008004100000245007500041210006900116260001600185100001500201700001400216700001900230856010100249 1996 eng d00aHeuristic-based CAT: Balancing item information, content, and exposure0 aHeuristicbased CAT Balancing item information content and exposu aNew York NY1 aLuecht, RM1 aHadadi, A1 aNungester, R J uhttp://www.iacat.org/content/heuristic-based-cat-balancing-item-information-content-and-exposure00474nas a2200121 4500008004100000245007600041210006900117260001600186100001500202700001900217700001400236856010200250 1996 eng d00aHeuristics based CAT: Balancing item information, content, and exposure0 aHeuristics based CAT Balancing item information content and expo aNew York NY1 aLuecht, RM1 aNungester, R J1 aHadadi, A uhttp://www.iacat.org/content/heuristics-based-cat-balancing-item-information-content-and-exposure00359nas a2200109 4500008004100000245004700041210004700088260001600135100001100151700001100162856007600173 1996 eng d00aMultidimensional computer adaptive testing0 aMultidimensional computer adaptive testing aNew York NY1 aFan, M1 aHsu, Y uhttp://www.iacat.org/content/multidimensional-computer-adaptive-testing00520nas a2200121 4500008004100000245010300041210006900144260001300213100002000226700001800246700001400264856012000278 1996 eng d00aNew algorithms for item selection and exposure and proficiency estimation under 1- and 2-PL models0 aNew algorithms for item selection and exposure and proficiency e aNew York1 aFeatherman, C M1 aSubhiyah, R G1 aHadadi, A uhttp://www.iacat.org/content/new-algorithms-item-selection-and-exposure-and-proficiency-estimation-under-1-and-2-pl00570nas a2200121 4500008004100000245009500041210006900136260008100205100001500286700001200301700001700313856011800330 1996 eng d00aPreliminary cost-effectiveness analysis of alternative ASVAB testing concepts at MET sites0 aPreliminary costeffectiveness analysis of alternative ASVAB test aInterim report to Defense Manpower Data Center. Fairfax, VA: Lewin-VHI, Inc.1 aHogan, P F1 aDall, T1 aMcBride, J R uhttp://www.iacat.org/content/preliminary-cost-effectiveness-analysis-alternative-asvab-testing-concepts-met-sites00478nas a2200109 4500008004100000245009900041210006900140260001600209100001100225700001100236856012100247 1996 eng d00aUtility of Fisher information, global information and different starting abilities in mini CAT0 aUtility of Fisher information global information and different s aNew York NY1 aFan, M1 aHsu, Y uhttp://www.iacat.org/content/utility-fisher-information-global-information-and-different-starting-abilities-mini-cat00466nas a2200109 4500008004100000245009500041210006900136260001900205100001100224700001100235856011000246 1995 eng d00aThe effect of ability estimation for polytomous CAT in different item selection procedures0 aeffect of ability estimation for polytomous CAT in different ite aMinneapolis MN1 aFan, M1 aHsu, Y uhttp://www.iacat.org/content/effect-ability-estimation-polytomous-cat-different-item-selection-procedures00552nas a2200133 4500008004100000245011000041210006900151260001800220100001200238700001100250700002100261700001400282856012200296 1995 eng d00aThe effect of population distribution and methods of theta estimation on CAT using the rating scale model0 aeffect of population distribution and methods of theta estimatio aSan Francisco1 aChen, S1 aHou, L1 aFitzpatrick, S J1 aDodd, B G uhttp://www.iacat.org/content/effect-population-distribution-and-methods-theta-estimation-cat-using-rating-scale-model00458nas a2200133 4500008004100000245006200041210006100103300001200164490000700176100001700183700002100200700001500221856008800236 1995 eng d00aEffects and underlying mechanisms of self-adapted testing0 aEffects and underlying mechanisms of selfadapted testing a103-1160 v871 aRocklin, T R1 aO’Donnell, A M1 aHolst, P M uhttp://www.iacat.org/content/effects-and-underlying-mechanisms-self-adapted-testing00643nas a2200121 4500008004100000245013600041210006900177260010500246100001500351700001700366700001600383856012200399 1995 eng d00aAn evaluation of alternative concepts for administering the Armed Services Vocational Aptitude Battery to applicants for enlistment0 aevaluation of alternative concepts for administering the Armed S aDMDC Technical Report 95-013. Monterey, CA: Personnel Testing Division, Defense Manpower Data Center1 aHogan, P F1 aMcBride, J R1 aCurran, L T uhttp://www.iacat.org/content/evaluation-alternative-concepts-administering-armed-services-vocational-aptitude-battery00474nas a2200109 4500008004100000245009300041210006900134260002200203100001600225700001300241856011000254 1995 eng d00aAn investigation of item calibration procedures for a computerized licensure examination0 ainvestigation of item calibration procedures for a computerized  aSan Francisco, CA1 aHaynie, K A1 aWay, W D uhttp://www.iacat.org/content/investigation-item-calibration-procedures-computerized-licensure-examination00431nas a2200109 4500008004100000245007100041210006900112300001200181490001800193100001600211856009400227 1995 eng d00aItem times in computerized testing: A new differential information0 aItem times in computerized testing A new differential informatio a108-1090 v11 (Suppl. 1)1 aHornke, L F uhttp://www.iacat.org/content/item-times-computerized-testing-new-differential-information00550nas a2200133 4500008004100000245012000041210006900161300001400230490000700244100001600251700001500267700001800282856011600300 1995 eng d00aTheoretical results and item selection from multidimensional item bank in the Mokken IRT model for polytomous items0 aTheoretical results and item selection from multidimensional ite a337–3520 v191 aHemker, B T1 aSijtsma, K1 aMolenaar, I W uhttp://www.iacat.org/content/theoretical-results-and-item-selection-multidimensional-item-bank-mokken-irt-model00506nas a2200109 4500008004100000245009300041210006900134260005300203100001300256700001500269856011200284 1995 eng d00aUsing simulation to select an adaptive testing strategy: An item bank evaluation program0 aUsing simulation to select an adaptive testing strategy An item  aUnpublished manuscript, University of Pittsburgh1 aHsu, T C1 aTseng, F L uhttp://www.iacat.org/content/using-simulation-select-adaptive-testing-strategy-item-bank-evaluation-program00480nas a2200133 4500008004100000245007400041210006900115300001200184490000700196100001600203700001600219700001600235856009500251 1994 eng d00aA comparison of item calibration media in computerized adaptive tests0 acomparison of item calibration media in computerized adaptive te a197-2040 v181 aHetter, R D1 aSegall, D O1 aBloxom, B M uhttp://www.iacat.org/content/comparison-item-calibration-media-computerized-adaptive-tests00464nas a2200121 4500008004500000245007600045210006900121490000700190100001600197700001600213700001600229856009700245 1994 Engldsh 00aA Comparison of Item Calibration Media in Computerized Adaptive Testing0 aComparison of Item Calibration Media in Computerized Adaptive Te0 v181 aHetter, R D1 aSegall, D O1 aBloxom, B M uhttp://www.iacat.org/content/comparison-item-calibration-media-computerized-adaptive-testing00460nas a2200109 4500008004100000245009400041210006900135260001600204100001600220700001300236856010100249 1994 eng d00aThe effects of item pool depth on the accuracy of pass/fail decisions for NCLEX using CAT0 aeffects of item pool depth on the accuracy of passfail decisions aNew Orleans1 aHaynie, K A1 aWay, W D uhttp://www.iacat.org/content/effects-item-pool-depth-accuracy-passfail-decisions-nclex-using-cat00524nas a2200121 4500008004100000245011800041210006900159300001200228490000700240100001800247700001600265856012100281 1994 eng d00aThe incomplete equivalence of the paper-and-pencil and computerized versions of the General Aptitude Test Battery0 aincomplete equivalence of the paperandpencil and computerized ve a852-8590 v791 aVan de Vijver1 aHarsveld, M uhttp://www.iacat.org/content/incomplete-equivalence-paper-and-pencil-and-computerized-versions-general-aptitude-test00513nas a2200133 4500008004100000245008100041210006900122300001000191490000700201653003400208100001900242700001600261856010200277 1993 eng d00aAssessing the utility of item response models: computerized adaptive testing0 aAssessing the utility of item response models computerized adapt a21-270 v1210acomputerized adaptive testing1 aKingsbury, G G1 aHouser, R L uhttp://www.iacat.org/content/assessing-utility-item-response-models-computerized-adaptive-testing00733nas a2200241 4500008004100000020002200041245005700063210005600120250001500176260000800191300001100199490000700210653003500217653002400252653002900276653001900305653001100324653002700335653001800362100001800380700001500398856007800413 1993 eng d a0276-5284 (Print)00aComputerized adaptive testing: the future is upon us0 aComputerized adaptive testing the future is upon us a1993/09/01 cSep a378-850 v1410a*Computer-Assisted Instruction10a*Education, Nursing10a*Educational Measurement10a*Reaction Time10aHumans10aPharmacology/education10aPsychometrics1 aHalkitis, P N1 aLeahy, J M uhttp://www.iacat.org/content/computerized-adaptive-testing-future-upon-us00414nas a2200121 4500008004100000245005600041210005200097260001500149100001400164700001900178700001600197856007900213 1993 eng d00aAn investigation of restricted self-adapted testing0 ainvestigation of restricted selfadapted testing aAtlanta GA1 aWise, S L1 aKingsbury, G G1 aHouser, R L uhttp://www.iacat.org/content/investigation-restricted-self-adapted-testing00543nas a2200121 4500008004100000245009600041210006900137260005100206100001600257700001600273700001600289856011600305 1993 eng d00aItem Calibration: Medium-of-administration effect on computerized adaptive scores (TR-93-9)0 aItem Calibration Mediumofadministration effect on computerized a aNavy Personnel Research and Development Center1 aHetter, R D1 aBloxom, B M1 aSegall, D O uhttp://www.iacat.org/content/item-calibration-medium-administration-effect-computerized-adaptive-scores-tr-93-900455nas a2200097 4500008004100000245009900041210006900140100001900209700001600228856011300244 1993 eng d00aA practical examination of the use of free-response questions in computerized adaptive testing0 apractical examination of the use of freeresponse questions in co1 aKingsbury, G G1 aHouser, R L uhttp://www.iacat.org/content/practical-examination-use-free-response-questions-computerized-adaptive-testing00475nas a2200121 4500008004100000245007600041210006900117260001800186100001500204700002100219700001700240856009600257 1992 eng d00aEffects of feedback during self-adapted testing on estimates of ability0 aEffects of feedback during selfadapted testing on estimates of a aSan Francisco1 aHolst, P M1 aO’Donnell, A M1 aRocklin, T R uhttp://www.iacat.org/content/effects-feedback-during-self-adapted-testing-estimates-ability00508nas a2200109 4500008004100000245005100041210005100092260014600143100001700289700001500306856007700321 1992 eng d00aEvaluation of alternative operational concepts0 aEvaluation of alternative operational concepts aProceedings of the 34th Annual Conference of the Military Testing Association. San Diego, CA: Navy Personnel Research and Development Center.1 aMcBride, J R1 aHogan, P F uhttp://www.iacat.org/content/evaluation-alternative-operational-concepts00481nas a2200121 4500008004100000245008900041210006900130300001000199490000700209100001500216700001600231856011200247 1992 eng d00aItem selection using an average growth approximation of target information functions0 aItem selection using an average growth approximation of target i a41-510 v161 aLuecht, RM1 aHirsch, T M uhttp://www.iacat.org/content/item-selection-using-average-growth-approximation-target-information-functions00453nas a2200109 4500008004100000245007800041210006900119260001900188100002100207700001500228856010000243 1992 eng d00aScaling of two-stage adaptive test configurations for achievement testing0 aScaling of twostage adaptive test configurations for achievement aNew Orleans LA1 aHendrickson, A B1 aKolen, M J uhttp://www.iacat.org/content/scaling-two-stage-adaptive-test-configurations-achievement-testing00599nas a2200121 4500008004100000245007100041210006800112260014900180100001800329700001400347700001900361856009700380 1991 eng d00aComputerized adaptive testing: Theory, applications, and standards0 aComputerized adaptive testing Theory applications and standards aR. K. Hambleton and J. N. Zaal (Eds.), Advances in educational and psychological testing: Theory and Applications (pp. 341-366). Boston: Kluwer.1 aHambleton, RK1 aZaal, J N1 aPieters, J P M uhttp://www.iacat.org/content/computerized-adaptive-testing-theory-applications-and-standards00469nas a2200109 4500008004100000245007800041210006900119260005300188100001700241700001300258856008800271 1991 eng d00aA simulation study of some simple approaches to the study of DIF for CATs0 asimulation study of some simple approaches to the study of DIF f aInternal memorandum, Educational Testing Service1 aHolland, P W1 aZwick, R uhttp://www.iacat.org/content/simulation-study-some-simple-approaches-study-dif-cats00507nas a2200133 4500008004100000245009100041210006900132300001200201490000700213100001300220700001600233700001600249856010800265 1990 eng d00aAdaptive designs for Likert-type data: An approach for implementing marketing research0 aAdaptive designs for Likerttype data An approach for implementin a304-3210 v271 aSingh, J1 aHowell, R D1 aRhoads, G K uhttp://www.iacat.org/content/adaptive-designs-likert-type-data-approach-implementing-marketing-research00454nas a2200109 4500008004100000245008100041210006900122260001400191100001900205700001600224856010400240 1990 eng d00aAssessing the utility of item response models: Computerized adaptive testing0 aAssessing the utility of item response models Computerized adapt aBoston MA1 aKingsbury, G G1 aHouser, R L uhttp://www.iacat.org/content/assessing-utility-item-response-models-computerized-adaptive-testing-000470nas a2200109 4500008004100000245010100041210006900142300001200211490000700223100001700230856011300247 1990 eng d00aThe effects of variable entry on bias and information of the Bayesian adaptive testing procedure0 aeffects of variable entry on bias and information of the Bayesia a785-8020 v501 aHankins, J A uhttp://www.iacat.org/content/effects-variable-entry-bias-and-information-bayesian-adaptive-testing-procedure00657nas a2200181 4500008004100000245008900041210006900130300000600199490000700205653001500212653001500227653003700242653002400279653002300303653001800326100001400344856011700358 1990 eng d00aNational Council Computerized Adaptive Testing Project Review--committee perspective0 aNational Council Computerized Adaptive Testing Project Reviewcom a30 v1110a*Computers10a*Licensure10aEducational Measurement/*methods10aFeasibility Studies10aSocieties, Nursing10aUnited States1 aHaynes, B uhttp://www.iacat.org/content/national-council-computerized-adaptive-testing-project-review-committee-perspective00541nas a2200145 4500008004100000245009400041210006900135300001200204490000700216100001500223700001500238700001700253700001400270856011100284 1989 eng d00aAdaptive and conventional versions of the DAT: The first complete test battery comparison0 aAdaptive and conventional versions of the DAT The first complete a363-3710 v131 aHenly, S J1 aKlebe, K J1 aMcBride, J R1 aCudeck, R uhttp://www.iacat.org/content/adaptive-and-conventional-versions-dat-first-complete-test-battery-comparison00547nas a2200145 4500008004500000245009400045210006900139300001200208490000700220100001500227700001500242700001700257700001400274856011300288 1989 Engldsh 00aAdaptive and Conventional Versions of the DAT: The First Complete Test Battery Comparison0 aAdaptive and Conventional Versions of the DAT The First Complete a363-3710 v131 aHenly, S J1 aKlebe, K J1 aMcBride, J R1 aCudeck, R uhttp://www.iacat.org/content/adaptive-and-conventional-versions-dat-first-complete-test-battery-comparison-000505nas a2200121 4500008004100000245009800041210006900139300000900208490000700217653003400224100001400258856011100272 1989 eng d00aApplication of computerized adaptive testing to the University Entrance Exam of Taiwan, R.O.C0 aApplication of computerized adaptive testing to the University E a36620 v4910acomputerized adaptive testing1 aHung, P-H uhttp://www.iacat.org/content/application-computerized-adaptive-testing-university-entrance-exam-taiwan-roc00520nas a2200109 4500008004100000245013200041210006900173260001800242100001900260700001600279856011500295 1989 eng d00aAssessing the impact of using item parameter estimates obtained from paper-and-pencil testing for computerized adaptive testing0 aAssessing the impact of using item parameter estimates obtained  aSan Francisco1 aKingsbury, G G1 aHouser, R L uhttp://www.iacat.org/content/assessing-impact-using-item-parameter-estimates-obtained-paper-and-pencil-testing00421nas a2200109 4500008004100000245006900041210006700110260001800177100001000195700001300205856009300218 1989 eng d00aA comparison of three adaptive testing strategies using MicroCAT0 acomparison of three adaptive testing strategies using MicroCAT aSan Francisco1 aHo, R1 aHsu, T C uhttp://www.iacat.org/content/comparison-three-adaptive-testing-strategies-using-microcat01130nas a2200157 4500008004100000245010500041210006900146300001200215490000600227520055900233100001500792700001600807700001500823700001000838856012400848 1989 eng d00aComparisons of paper-administered, computer-administered and computerized adaptive achievement tests0 aComparisons of paperadministered computeradministered and comput a311-3260 v53 aThis research study was designed to compare student achievement scores from three different testing methods: paper-administered testing, computer-administered testing, and computerized adaptive testing. The three testing formats were developed from the California Assessment Program (CAP) item banks for grades three and six. The paper-administered and the computer-administered tests were identical in item content, format, and sequence. The computerized adaptive test was a tailored or adaptive sequence of the items in the computer-administered test. 1 aOlson, J B1 aMaynes, D D1 aSlawson, D1 aHo, K uhttp://www.iacat.org/content/comparisons-paper-administered-computer-administered-and-computerized-adaptive-achievement00509nas a2200109 4500008004100000245011200041210006900153260001900222100001900241700001600260856012300276 1988 eng d00aA comparison of achievement level estimates from computerized adaptive testing and paper-and-pencil testing0 acomparison of achievement level estimates from computerized adap aNew Orleans LA1 aKingsbury, G G1 aHouser, R L uhttp://www.iacat.org/content/comparison-achievement-level-estimates-computerized-adaptive-testing-and-paper-and-pencil00540nas a2200109 4500008004100000245011600041210006900157260005300226100001400279700001700293856012000310 1988 eng d00aThe development and evaluation of a microcomputerized adaptive placement testing system for college mathematics0 adevelopment and evaluation of a microcomputerized adaptive place a1986 (San Francisco CA) and 1987 (Washington DC)1 aHsu, T -C1 aShermis, M D uhttp://www.iacat.org/content/development-and-evaluation-microcomputerized-adaptive-placement-testing-system-college00557nas a2200109 4500008004100000245013000041210006900171260005400240100001400294700001600308856012300324 1988 eng d00aThe equivalence of scores from automated and conventional educational and psychological tests (College Board Report No. 88-8)0 aequivalence of scores from automated and conventional educationa aNew York: The College Entrance Examination Board.1 aMazzeo, J1 aHarvey, A L uhttp://www.iacat.org/content/equivalence-scores-automated-and-conventional-educational-and-psychological-tests-college00386nas a2200109 4500008004100000245005500041210005300096260001900149100001500168700001400183856007900197 1988 eng d00aA predictive analysis approach to adaptive testing0 apredictive analysis approach to adaptive testing aNew Orleans LA1 aKirisci, L1 aHsu, T -C uhttp://www.iacat.org/content/predictive-analysis-approach-adaptive-testing00497nam a2200097 4500008004100000245010100041210006900142260005600211100001700267856011500284 1987 eng d00aThe effects of variable entry on bias and information of the Bayesian adaptive testing procedure0 aeffects of variable entry on bias and information of the Bayesia aDissertation Abstracts International, 47 (8A), 30131 aHankins, J A uhttp://www.iacat.org/content/effects-variable-entry-bias-and-information-bayesian-adaptive-testing-procedure-000566nas a2200133 4500008004100000245012100041210006900162260002100231100001500252700001600267700001500283700001000298856012400308 1986 eng d00aComparison and equating of paper-administered, computer-administered, and computerized adaptive tests of achievement0 aComparison and equating of paperadministered computeradministere aSan Francisco CA1 aOlsen, J B1 aMaynes, D D1 aSlawson, D1 aHo, K uhttp://www.iacat.org/content/comparison-and-equating-paper-administered-computer-administered-and-computerized-adaptive00479nas a2200121 4500008004100000245008600041210006900127300001000196490000700206100001700213700001600230856011100246 1985 Eng d00aControlling item exposure conditional on ability in computerized adaptive testing0 aControlling item exposure conditional on ability in computerized a57-750 v231 aSympson, J B1 aHetter, R D uhttp://www.iacat.org/content/controlling-item-exposure-conditional-ability-computerized-adaptive-testing-000572nas a2200109 4500008004100000245006900041210006800110260015600178100001700334700001600351856009500367 1985 eng d00aControlling item-exposure rates in computerized adaptive testing0 aControlling itemexposure rates in computerized adaptive testing aProceedings of the 27th annual meeting of the Military Testing Association (pp. 973-977). San Diego CA: Navy Personnel Research and Development Center.1 aSympson, J B1 aHetter, R D uhttp://www.iacat.org/content/controlling-item-exposure-rates-computerized-adaptive-testing00529nas a2200133 4500008004100000245006100041210006100102260009000163100001700253700001400270700001700284700001400301856008000315 1984 eng d00aEvaluation of computerized adaptive testing of the ASVAB0 aEvaluation of computerized adaptive testing of the ASVAB aSan Diego, CA: Navy Personnel Research and Development Center, unpublished manuscript1 aHardwicke, S1 aVicino, F1 aMcBride, J R1 aNemeth, C uhttp://www.iacat.org/content/evaluation-computerized-adaptive-testing-asvab00441nas a2200109 4500008004100000245007800041210006900119260001200188100001600200700001900216856009600235 1984 eng d00aAn evaluation of the utility of large scale computerized adaptive testing0 aevaluation of the utility of large scale computerized adaptive t aChicago1 aVicino, F L1 aHardwicke, S B uhttp://www.iacat.org/content/evaluation-utility-large-scale-computerized-adaptive-testing-000446nas a2200109 4500008004100000245007800041210006900119260001900188100001600207700001900223856009400242 1984 eng d00aAn evaluation of the utility of large scale computerized adaptive testing0 aevaluation of the utility of large scale computerized adaptive t aNew Orleans LA1 aVicino, F L1 aHardwicke, S B uhttp://www.iacat.org/content/evaluation-utility-large-scale-computerized-adaptive-testing00542nas a2200133 4500008004100000245010100041210006900142100001400211700001400225700001900239700001300258700001700271856012000288 1984 eng d00aEvaluation plan for the computerized adaptive vocational aptitude battery (Research Report 82-1)0 aEvaluation plan for the computerized adaptive vocational aptitud1 aGreen, BF1 aBock, R D1 aHumphreys, L G1 aLinn, RL1 aReckase, M D uhttp://www.iacat.org/content/evaluation-plan-computerized-adaptive-vocational-aptitude-battery-research-report-82-100655nas a2200205 4500008004100000020001400041245006700055210006700122300001200189490000700201653003400208653001700242653002100259100001400280700001400294700001900308700001300327700001700340856009200357 1984 eng d a1745-398400aTechnical guidelines for assessing computerized adaptive tests0 aTechnical guidelines for assessing computerized adaptive tests a347-3600 v2110acomputerized adaptive testing10aMode effects10apaper-and-pencil1 aGreen, BF1 aBock, R D1 aHumphreys, L G1 aLinn, RL1 aReckase, M D uhttp://www.iacat.org/content/technical-guidelines-assessing-computerized-adaptive-tests00479nas a2200109 4500008004100000245008400041210006900125260004100194100001700235700001500252856010200267 1983 eng d00aPredictive utility evaluation of adaptive testing: Results of the Navy research0 aPredictive utility evaluation of adaptive testing Results of the aFalls Church VA: The Rehab Group Inc1 aHardwicke, S1 aWhite, K E uhttp://www.iacat.org/content/predictive-utility-evaluation-adaptive-testing-results-navy-research00412nas a2200097 4500008004100000245005200041210005200093260007500145100001600220856007800236 1982 eng d00aComparison of live and simulated adaptive tests0 aComparison of live and simulated adaptive tests aBrooks Air Force Base, TexasbAir Force Systems CommandcDecember 19821 aHUnter, D R uhttp://www.iacat.org/content/comparison-live-and-simulated-adaptive-tests00679nas a2200109 4500008004100000245010300041210006900144260020000213100001700413700001300430856012600443 1982 eng d00aItem Calibrations for Computerized Adaptive Testing (CAT) Experimental Item Pools Adaptive Testing0 aItem Calibrations for Computerized Adaptive Testing CAT Experime aD. J. Weiss (Ed.). Proceedings of the 1982 Computerized Adaptive Testing Conference (pp. 290-294). Minneapolis MN: University of Minnesota, Department of Psychology, Psychometric Methods Program.1 aSympson, J B1 aHartmann uhttp://www.iacat.org/content/item-calibrations-computerized-adaptive-testing-cat-experimental-item-pools-adaptive-testing00595nas a2200109 4500008004100000245006600041210006400107260019800171100001600369700001600385856008400401 1980 eng d00aA validity study of an adaptive test of reading comprehension0 avalidity study of an adaptive test of reading comprehension aD. J. Weiss (Ed.), Proceedings of the 1979 Computerized Adaptive Testing Conference (pp. 57-67). Minneapolis MN: University of Minnesota, Department of Psychology, Psychometric Methods Program.1 aHornke, L F1 aSauter, M B uhttp://www.iacat.org/content/validity-study-adaptive-test-reading-comprehension00506nas a2200121 4500008004100000245010500041210006900146300000900215490000700224100001600231700001500247856012200262 1979 eng d00aA comparison of a standard and a computerized adaptive paradigm in Bekesy fixed-frequency audiometry0 acomparison of a standard and a computerized adaptive paradigm in a1-220 v191 aHarris, J D1 aSmith, P F uhttp://www.iacat.org/content/comparison-standard-and-computerized-adaptive-paradigm-bekesy-fixed-frequency-audiometry00368nas a2200109 4500008004100000245005200041210005200093300001200145490000700157100001600164856007800180 1979 eng d00aFour realizations of pyramidal adaptive testing0 aFour realizations of pyramidal adaptive testing a164-1690 v161 aHornke, L F uhttp://www.iacat.org/content/four-realizations-pyramidal-adaptive-testing00364nas a2200121 4500008004100000245004300041210004300084300001200127490000700139100001400146700001500160856006700175 1978 eng d00aPredictive ability of a branching test0 aPredictive ability of a branching test a415-4190 v381 aBrooks, S1 aHartz, M A uhttp://www.iacat.org/content/predictive-ability-branching-test00403nas a2200133 4500008003900000245004900039210004700088300001200135490000700147100001300154700001500167700001400182856007300196 1978 d00aA stratified adaptive test of verbal ability0 astratified adaptive test of verbal ability a229-2380 v261 aShiba, S1 aNoguchi, H1 aHaebra, T uhttp://www.iacat.org/content/stratified-adaptive-test-verbal-ability00567nas a2200109 4500008003900000245005900039210005800098260018500156100001700341700001600358856008300374 1977 d00aAdaptive Branching in a Multi-Content Achievement Test0 aAdaptive Branching in a MultiContent Achievement Test aD. J. Weiss (Ed.), Proceedings of the 1977 Computerized Adaptive Testing Conference. Minneapolis MN: University of Minnesota, Department of Psychology, Psychometric Methods Program1 aPennell, R J1 aHarris, D A uhttp://www.iacat.org/content/adaptive-branching-multi-content-achievement-test00631nas a2200109 4500008003900000245008400039210006900123260018500192100001800377700001600395856011000411 1977 d00aAdaptive Testing Applied to Hierarchically Structured Objectives-Based Programs0 aAdaptive Testing Applied to Hierarchically Structured Objectives aD. J. Weiss (Ed.), Proceedings of the 1977 Computerized Adaptive Testing Conference. Minneapolis MN: University of Minnesota, Department of Psychology, Psychometric Methods Program1 aHambleton, RK1 aEignor, D R uhttp://www.iacat.org/content/adaptive-testing-applied-hierarchically-structured-objectives-based-programs01595nas a2200133 4500008004100000245010600041210006900147300001200216490000700228520106500235100001701300700001801317856012601335 1977 eng d00aA computer simulation study of tailored testing strategies for objective-based instructional programs0 acomputer simulation study of tailored testing strategies for obj a139-1580 v373 aOne possible way of reducing the amount of time spent testing in . objective-based instructional programs would involve the implementation of a tailored testing strategy. Our purpose was to provide some additional data on the effectiveness of various tailored testing strategies for different testing situations. The three factors of a tailored testing strategy under study with various hypothetical distributions of abilities across two learning hierarchies were test length, mastery cutting score, and starting point. Overall, our simulation results indicate that it is possible to obtain a reduction of more than 50% in testing time without any loss in decision-making accuracy, when compared to a conventional testing procedure, by implementing a tailored testing strategy. In addition, our study of starting points revealed that it was generally best to begin testing in the middle of the learning hierarchy. Finally we observed a 40% reduction in errors of classification as the number of items for testing each objective was increased from one to five.1 aSpineti, J P1 aHambleton, RK uhttp://www.iacat.org/content/computer-simulation-study-tailored-testing-strategies-objective-based-instructional-programs00488nas a2200121 4500008004100000245007500041210006900116260003700185100001600222700001200238700001600250856010000266 1977 eng d00aFlexilevel adaptive testing paradigm: Validation in technical training0 aFlexilevel adaptive testing paradigm Validation in technical tra aAFHRL Technical Report 77-35 (I)1 aHansen, D N1 aRoss, S1 aHarris, D A uhttp://www.iacat.org/content/flexilevel-adaptive-testing-paradigm-validation-technical-training00492nas a2200121 4500008004100000245007500041210006900116260003800185100001600223700001200239700001600251856010300267 1977 eng d00aFlexilevel adaptive training paradigm: Hierarchical concept structures0 aFlexilevel adaptive training paradigm Hierarchical concept struc aAFHRL Technical Report 77-35 (II)1 aHansen, D N1 aRoss, S1 aHarris, D A uhttp://www.iacat.org/content/flexilevel-adaptive-training-paradigm-hierarchical-concept-structures00412nas a2200097 4500008004100000245006300041210006300104260004200167100001600209856008900225 1977 eng d00aFour realizations of pyramidal adaptive testing strategies0 aFour realizations of pyramidal adaptive testing strategies aUniversity of Leiden, The Netherlands1 aHornke, L F uhttp://www.iacat.org/content/four-realizations-pyramidal-adaptive-testing-strategies00442nas a2200097 4500008004100000245003600041210003600077260015300113100001600266856006200282 1976 eng d00aReflections on adaptive testing0 aReflections on adaptive testing aC. K. Clark (Ed.), Proceedings of the First Conference on Computerized Adaptive Testing (pp. 90-94). Washington DC: U.S. Government Printing Office.1 aHansen, D N uhttp://www.iacat.org/content/reflections-adaptive-testing00360nas a2200109 4500008004100000245004600041210004400087260002400131100001100155700001400166856007000180 1974 eng d00aA Bayesian approach in sequential testing0 aBayesian approach in sequential testing aChicago ILc04/19741 aHsu, T1 aPingel, K uhttp://www.iacat.org/content/bayesian-approach-sequential-testing00740nas a2200145 4500008004100000245018400041210006900225260010800294100001600402700001700418700001500435700001100450700001200461856012100473 1974 eng d00aComputer-based adaptive testing models for the Air Force technical training environment: Phase I: Development of a computerized measurement system for Air Force technical Training0 aComputerbased adaptive testing models for the Air Force technica aJSAS Catalogue of Selected Documents in Psychology, 5, 1-86 (MS No. 882). AFHRL Technical Report 74-48.1 aHansen, D N1 aJohnson, B F1 aFagan, R L1 aTan, P1 aDick, W uhttp://www.iacat.org/content/computer-based-adaptive-testing-models-air-force-technical-training-environment-phase-i00466nas a2200109 4500008004100000245009200041210006900133300001200202490000700214100001800221856011700239 1974 eng d00aTesting and decision-making procedures for selected individualized instruction programs0 aTesting and decisionmaking procedures for selected individualize a371-4000 v101 aHambleton, RK uhttp://www.iacat.org/content/testing-and-decision-making-procedures-selected-individualized-instruction-programs00464nas a2200097 4500008004100000245008200041210006900123260005200192100001800244856010400262 1973 eng d00aA review of testing and decision-making procedures (Technical Bulletin No. 150 areview of testing and decisionmaking procedures Technical Bullet aIowa City IA: American College Testing Program.1 aHambleton, RK uhttp://www.iacat.org/content/review-testing-and-decision-making-procedures-technical-bulletin-no-1500566nas a2200109 4500008004100000245011200041210006900153260008500222100001800307700001100325856012000336 1971 eng d00aThe application of item generators for individualizing mathematics testing and instruction (Report 1971/14)0 aapplication of item generators for individualizing mathematics t aPittsburgh PA: University of Pittsburgh Learning Research and Development Center1 aFerguson, R L1 aHsu, T uhttp://www.iacat.org/content/application-item-generators-individualizing-mathematics-testing-and-instruction-report00442nas a2200097 4500008004100000245004600041210004500087260012000132100001800252856007400270 1970 eng d00aIndividually tailored testing: Discussion0 aIndividually tailored testing Discussion aW. H. Holtzman, (Ed.), Computer-assisted instruction, testing, and guidance (pp.198-200). New York: Harper and Row.1 aHoltzman, W H uhttp://www.iacat.org/content/individually-tailored-testing-discussion00462nas a2200097 4500008004100000245005500041210005100096260012100147100001600268856008000284 1969 eng d00aAn investigation of computer-based science testing0 ainvestigation of computerbased science testing aR. C. Atkinson and H. A. Wilson (Eds.), Computer-assisted instruction: A book of readings. New York: Academic Press.1 aHansen, D N uhttp://www.iacat.org/content/investigation-computer-based-science-testing-100386nam a2200121 4500008004100000245003700041210003300078260004600111100001600157700001400173700001400187856006300201 1968 eng d00aComputer-assisted testing (Eds.)0 aComputerassisted testing Eds aPrinceton NJ: Educational Testing Service1 aHarman, H H1 aHelm, C E1 aLoye, D E uhttp://www.iacat.org/content/computer-assisted-testing-eds00439nas a2200109 4500008004100000245005500041210005100096260007100147100001600218700001500234856008000249 1968 eng d00aAn investigation of computer-based science testing0 ainvestigation of computerbased science testing aTallahassee: Institute of Human Learning, Florida State University1 aHansen, D N1 aSchwarz, G uhttp://www.iacat.org/content/investigation-computer-based-science-testing-000411nas a2200109 4500008004100000245005500041210005100096260004500147100001600192700001500208856007800223 1968 eng d00aAn investigation of computer-based science testing0 ainvestigation of computerbased science testing aTallahassee FL: Florida State University1 aHansen, D N1 aSchwarz, G uhttp://www.iacat.org/content/investigation-computer-based-science-testing00511nas a2200097 4500008004100000245008600041210006900127260010200196100001700298856009800315 1966 eng d00aProgrammed testing in the examinations of the National Board of Medical Examiners0 aProgrammed testing in the examinations of the National Board of  aA. Anastasi (Ed.), Testing problems in perspective. Washington DC: American Council on Education.1 aHubbard, J P uhttp://www.iacat.org/content/programmed-testing-examinations-national-board-medical-examiners00320nas a2200121 4500008004100000245002900041210002500070300000800095490000600103100001900109700001600128856005400144 1956 eng d00aThe sequential item test0 asequential item test a4190 v21 aKrathwohl, D R1 aHuyser, R J uhttp://www.iacat.org/content/sequential-item-test00445nas a2200109 4500008004100000245008900041210006900130300001100199490000700210100001400217856010400231 1947 eng d00aA clinical study of consecutive and adaptive testing with the revised Stanford-Binet0 aclinical study of consecutive and adaptive testing with the revi a93-1030 v111 aHutt, M L uhttp://www.iacat.org/content/clinical-study-consecutive-and-adaptive-testing-revised-stanford-binet