A procedure to compare conventional and adaptive testing procedures for making single-point decisions - Kingsbury, G. G.; A Zara (Paper presented at the annual meeting of the National Council on Measurement in Education, 1999)

The rationale and principles of stratum scoring - Wise, S. L. (Paper presented at the annual meeting of the National Council on Measurement in Education, 1999)

Reducing bias in CAT trait estimation: A comparison of approaches - Wang, T.; Hanson, B. H.; C.-M. H. Lau (Applied Psychological Measurement, 1999)

Reducing item exposure without reducing precision (much) in computerized adaptive testing - Holmes, R. M.; Segall, D. O. (Paper presented at the annual meeting of the National Council on Measurement in Education, 1999)

Research and development of a computer-adaptive test of listening comprehension in the less-commonly taught language Hausa - Dunkel, P. (1999)

Response time feedback on computer-administered tests - Scrams, D. J.; Schnipke, D. L. (Paper presented at the annual meeting of the National Council on Measurement in Education, 1999)

The robustness of the unidimensional 3PL IRT model when applied to two-dimensional data in computerized adaptive testing - Zhao, J. C. (1999)

Some relationship among issues in CAT item pool management - Wang, T. (1999)

Some reliability estimates for computerized adaptive tests - Nicewander, W. A.; Thomasson, G. L. (Applied Psychological Measurement, 1999)
Three reliability estimates are derived for the Bayes modal estimate (BME) and the maximum likelihood estimate (MLE) of θin computerized adaptive tests (CAT). Each reliability estimate is a function of test information. Two of the estimates are shown to be upper bounds to true reliability. The three reliability estimates and the true reliabilities of both MLE and BME were computed for seven simulated CATs. Results showed that the true reliabilities for MLE and BME were nearly identical in all seven tests. The three reliability estimates never differed from the true reliabilities by more than .02 (.01 in most cases). A simple implementation of one reliability estimate was found to accurately estimate reliability in CATs.

Standard errors of proficiency estimates in stratum scored CAT - Kingsbury, G. G. (Paper presented at the annual meeting of the National Council on Measurement in Education, 1999)

Study of methods to detect aberrant response patterns in computerized testing - Iwamoto, C. K.; Nungester, R. J.; Luecht, RM (Paper presented at the annual meeting of the National Council on Measurement in Education, 1999)

Test anxiety and test performance: Comparing paper-based and computer-adaptive versions of the GRE General Test (Research Report 99-15) - Powers, D. E. (1999)

Testing adaptatif et évaluation des processus cognitifs - Laurier, M. (1999)

Tests informatizados: Fundamentos y aplicaciones (Computerized testing: Fundamentals and applications - Olea, J.; Ponsoda, V.; Prieto, G., Eds. (1999)

Test-taking strategies - Steffen, M. (Paper presented at the annual meeting of the National Council on Measurement in Education, 1999)

Test-taking strategies in computerized adaptive testing - Steffen, M.; Way, W. D. (Paper presented at the annual meeting of the National Council on Measurement in Education, 1999)

Threats to score comparability with applications to performance assessments and computerized adaptive tests - Kolen, M. J. (Educational Assessment, 1999)
Develops a conceptual framework that addresses score comparability for performance assessments, adaptive tests, paper-and-pencil tests, and alternate item pools for computerized tests. Outlines testing situation aspects that might threaten score comparability and describes procedures for evaluating the degree of score comparability. Suggests ways to minimize threats to comparability. (SLD)

Threats to score comparability with applications to performance assessments and computerized adaptive tests - Kolen, M. J. (Educational Assessment, 1999)

Use of conditional item exposure methodology for an operational CAT - Anderson, D. (Paper presented at the annual meeting of the National Council on Measurement in Education, 1999)

The use of linear-on-the-fly testing for TOEFL Reading - Carey, P. A. (Paper presented at the annual meeting of the National Council on Measurement in Education, 1999)

The use of Rasch analysis to produce scale-free measurement of functional ability - Velozo, C. A.; Kielhofner, G.; Lai, J-S. (American Journal of Occupational Therapy, 1999)
Innovative applications of Rasch analysis can lead to solutions for traditional measurement problems and can produce new assessment applications in occupational therapy and health care practice. First, Rasch analysis is a mechanism that translates scores across similar functional ability assessments, thus enabling the comparison of functional ability outcomes measured by different instruments. This will allow for the meaningful tracking of functional ability outcomes across the continuum of care. Second, once the item-difficulty order of an instrument or item bank is established by Rasch analysis, computerized adaptive testing can be used to target items to the patient's ability level, reducing assessment length by as much as one half. More importantly, Rasch analysis can provide the foundation for "equiprecise" measurement or the potential to have precise measurement across all levels of functional ability. The use of Rasch analysis to create scale-free measurement of functional ability demonstrates how this methodlogy can be used in practical applications of clinical and outcome assessment.
Keywords: *Activities of Daily Living; Disabled Persons/*classification; Human; Occupational Therapy/*methods; Predictive Value of Tests; Questionnaires/standards; Sensitivity and Specificity

Using Bayesian decision theory to design a computerized mastery test - Vos, H. J. (Journal of Educational and Behavioral Statistics, 1999)

Using response-time constraints to control for differential speededness in computerized adaptive testing - van der Linden, W. J.; Scrams, D. J.; Schnipke, D. L. (Applied Psychological Measurement, 1999)
An item-selection algorithm is proposed for neutralizing the differential effects of time limits on computerized adaptive test scores. The method is based on a statistical model for distributions of examinees’ response times on items in a bank that is updated each time an item is administered. Predictions from the model are used as constraints in a 0-1 linear programming model for constrained adaptive testing that maximizes the accuracy of the trait estimator. The method is demonstrated empirically using an item bank from the Armed Services Vocational Aptitude Battery.
Keywords: computerized adaptive testing

WISCAT: Een computergestuurd toetspakket voor rekenen en wiskunde [A computerized test package for arithmetic and mathematics] - Cito. (1999)

Adaptive mastery testing using the Rasch model and Bayesian sequential decision theory (Research Report 98-15) - Glas, C. A. W.; Vos, H. J. (1998)

Adaptive testing without IRT - Yan, D.; Lewis, C.; Stocking, M. (Paper presented at the annual meeting of the National Council on Measurement in Education, 1998)

Alternatives for scoring computerized adaptive tests - Dodd, B. G.; Fitzpatrick, S. J. (Paper presented at an Educational Testing Service-sponsored colloquium entitled Computer-based testing: Building the foundations for future assessments, 1998)

Alternatives for scoring computerized adaptive tests - Dodd, B. G.; Fitzpatrick, S. J. (Computer-based testing, 1998)

Application of an IRT ideal point model to computer adaptive assessment of job performance - Stark, S.; F Drasgow (Paper presented at the annual meeting of the Society for Industrial and Organization Psychology, 1998)

Application of direct optimization for on-line calibration in computerized adaptive testing - Krass, I. A. (Paper presented at the annual meeting of the National Council on Measurement in Education, 1998)

Applications of network flows to computerized adaptive testing - Cordova, M. J. (1998)

Applications of network flows to computerized adaptive testing - Claudio, M. J. C. (Dissertation Abstracts International: Section B: the Sciences & Engineering, 1998)
Recently, the concept of Computerized Adaptive Testing (CAT) has been receiving ever growing attention from the academic community. This is so because of both practical and theoretical considerations. Its practical importance lies in the advantages of CAT over the traditional (perhaps outdated) paper-and-pencil test in terms of time, accuracy, and money. The theoretical interest is sparked by its natural relationship to Item Response Theory (IRT). This dissertation offers a mathematical programming approach which creates a model that generates a CAT that takes care of many questions concerning the test, such as feasibility, accuracy and time of testing, as well as item pool security. The CAT generated is designed to obtain the most information about a single test taker. Several methods for eatimating the examinee's ability, based on the (dichotomous) responses to the items in the test, are also offered here. (PsycINFO Database Record (c) 2003 APA, all rights reserved).
Keywords: computerized adaptive testing

A Bayesian approach to detection of item preknowledge in a CAT - McLeod, L. D.; Lewis, C. (Paper presented at the annual meeting of the National Council on Measurement in Education, 1998)

Bayesian identification of outliers in computerized adaptive testing - Bradlow, E. T.; Weiss, R. E.; Cho, M. (Journal of the American Statistical Association, 1998)
We consider the problem of identifying examinees with aberrant response patterns in a computerized adaptive test (CAT). The vec-tor of responses yi of person i from the CAT comprise a multivariate response vector. Multivariate observations may be outlying in manydi erent directions and we characterize speci c directions as corre- sponding to outliers with different interpretations. We develop a class of outlier statistics to identify different types of outliers based on a con-trol chart type methodology. The outlier methodology is adaptable to general longitudinal discrete data structures. We consider several procedures to judge how extreme a particular outlier is. Data from the National Council Licensure EXamination (NCLEX) motivates our development and is used to illustrate the results.

Bayesian item selection criteria for adaptive testing - van der Linden, W. J. (Psychometrika, 1998)

Capitalization on item calibration error in adaptive testing (Research Report 98-07) - van der Linden, W. J.; Glas, C. A. W. (1998)

CASTISEL [Computer software] - Luecht, RM (1998)

CAT item calibration - Hsu, Y.; Thompson, T.D.; Chen, W-H. (Paper presented at the annual meeting of the National Council on Measurement in Education, 1998)

CAT Item exposure control: New evaluation tools, alternate methods and integration into a total CAT program - Thomasson, G. L. (Paper presented at the annual meeting of the National Council of Measurement in Education, 1998)

Comparability of paper-and-pencil and computer adaptive test scores on the GRE General Test - Schaeffer, G. A.; Bridgeman, B.; Golub-Smith, M. L.; Lewis, C.; Potenza, M. T.; Steffen, M. (Educational Testing Services, 1998)

Comparability of paper-and-pencil and computer adaptive test scores on the GRE General Test (GRE Board Professional Report No 95-08P; Educational Testing Service Research Report 98-38) - Schaeffer, G.; Bridgeman, B.; Golub-Smith, M. L.; Lewis, C.; Potenza, M. T.; Steffen, M. (1998)

A comparative study of item exposure control methods in computerized adaptive testing - Chang, S-W. (1998)

A comparative study of item exposure control methods in computerized adaptive testing - Chang, S-W.; Twu, B.-Y. (1998)

Comparing and combining dichotomous and polytomous items with SPRT procedure in computerized classification testing - Lau, CA; Wang, T. (Paper presented at the annual meeting of the American Educational Research Association, 1998)

A comparison of item exposure control methods in computerized adaptive testing - Revuelta, J.,; Ponsoda, V. (Journal of Educational Measurement, 1998)

A comparison of maximum likelihood estimation and expected a posteriori estimation in CAT using the partial credit model - Chen, S.; Hou, L.; Dodd, B. G. (Educational and Psychological Measurement, 1998)

A comparison of two methods of controlling item exposure in computerized adaptive testing - Tang, L.; Jiang, H.; Chang, Hua-Hua (Paper presented at the meeting of the American Educational Research Association. San Diego CA., 1998)

Computer adaptive testing – Approaches for item selection and measurement - Armstrong, R. D.; Jones, D. H. (1998)

Computer-assisted test assembly using optimization heuristics - Luecht, RM (Applied Psychological Measurement, 1998)

Computerized adaptive rating scales that measure contextual performance - Borman, W. C.; Hanson, M. A.; Montowidlo, S. J; F Drasgow; Foster, L; Kubisiak, U. C. (Paper presented at the 3th annual conference of the Society for Industrial and Organizational Psychology, 1998)

Computerized adaptive testing: What it is and how it works - Straetmans, G. J. J. M.; Theo Eggen (Educational Technology, 1998)
Describes the workings of computerized adaptive testing (CAT). Focuses on the key concept of information and then discusses two important components of a CAT system: the calibrated item bank and the testing algorithm. Describes a CAT that was designed for making placement decisions on the basis of two typical test administrations and notes the most significant differences between traditional paper-based testing and CAT. (AEF)

Computerized adaptive testing with multiple form structures - Armstrong, R. D.; Jones, D. H.; Berliner, N. (Paper presented at the annual meeting of the Psychometric Society, 1998)

Constructing adaptive tests to parallel conventional programs - Thompson, T.; Davey, T.; Nering, M. L. (Paper presented at the annual meeting of the National Council on Measurement in Education, 1998)

Constructing passage-based tests that parallel conventional programs - Thompson, T.; Davey, T.; Nering, M. L. (Paper presented at the annual meeting of the Psychometric Society, 1998)

Controlling item exposure and maintaining item security - Davey, T.; Nering, M. L. (Paper presented at an Educational Testing Service-sponsored colloquium entitled “Computer-based testing: Building the foundations for future assessments, 1998)

Controlling item exposure conditional on ability in computerized adaptive testing - Stocking, M. L.; Lewis, C. (Journal of Educational & Behavioral Statistics, 1998)
The interest in the application of large-scale adaptive testing for secure tests has served to focus attention on issues that arise when theoretical advances are made operational. One such issue is that of ensuring item and pool security in the continuous testing environment made possible by the computerized admin-istration of a test, as opposed to the more periodic testing environment typically used for linear paper-and-pencil tests. This article presents a new method of controlling the exposure rate of items conditional on ability level in this continuous testing environment. The properties of such conditional control on the exposure rates of items, when used in conjunction with a particular adaptive testing algorithm, are explored through studies with simulated data.

Developing, maintaining, and renewing the item inventory to support computer-based testing - Way, W. D.; Steffen, M.; Anderson, G. S. (Paper presented at the colloquium, 1998)

Development and evaluation of online calibration procedures (TCN 96-216) - Levine, M. L.; Williams. (1998)

Does adaptive testing violate local independence? (Research Report 98-33) - Mislevy, R. J.; Chang, Hua-Hua (1998)

The effect of item pool restriction on the precision of ability measurement for a Rasch-based CAT: comparisons to traditional fixed length examinations - Halkitis, P. N. (J Outcome Meas, 1998)
This paper describes a method for examining the precision of a computerized adaptive test with a limited item pool. Standard errors of measurement ascertained in the testing of simulees with a CAT using a restricted pool were compared to the results obtained in a live paper-and-pencil achievement testing of 4494 nursing students on four versions of an examination of calculations of drug administration. CAT measures of precision were considered when the simulated examine pools were uniform and normal. Precision indices were also considered in terms of the number of CAT items required to reach the precision of the traditional tests. Results suggest that regardless of the size of the item pool, CAT provides greater precision in measurement with a smaller number of items administered even when the choice of items is limited but fails to achieve equiprecision along the entire ability continuum.
Keywords: *Decision Making, Computer-Assisted; Comparative Study; Computer Simulation; Education, Nursing; Educational Measurement/*methods; Human; Models, Statistical; Psychometrics/*methods

Effect of item selection on item exposure rates within a computerized classification test - Kalohn, J.C.; Spray, J. A. (Paper presented at the annual meeting of the National Council on Measurement in Education, 1998)

An empirical Bayes approach to Mantel-Haenszel DIF analysis: Theoretical development and application to CAT data - Zwick, R. (Paper presented at the annual meeting of the Psychometric Society, 1998)

Essentially unbiased Bayesian estimates in computerized adaptive testing - Wang, T.; Lau, C.; Hanson, B. A. (Paper presented at the annual meeting of the American Educational Research Association, 1998)

Evaluating and insuring measurement precision in adaptive testing - Davey, T.; Nering, M. L. (Paper presented at the annual meeting of the Psychometric Society, 1998)

Evaluation of methods for the use of underutilized items in a CAT environment - Steffen, M.; Liu, M. (Paper presented at the annual meeting of the Psychometric Society, 1998)

An examination of item-level response times from an operational CAT - Swygert, K. (Paper presented at the annual meeting of the National Council on Measurement in Education, 1998)

Expected losses for individuals in Computerized Mastery Testing - Smith, R.; Lewis, C. (Paper presented at the annual meeting of National Council on Measurement in Education, 1998)

Feasibility studies of two-stage testing in large-scale educational assessment: Implications for NAEP - Bock, R. D.; Zimowski, M. F. (1998)

A framework for comparing adaptive test designs - Stocking, M. L. (1998)

A framework for exploring and controlling risks associated with test item exposure over time - Luecht, RM (Paper presented at the Annual Meeting of the National Council for Measurement in Education, 1998)

A hybrid method for controlling item exposure in computerized adaptive testing - Nering, M. L.; Davey, T.; Thompson, T. (Paper presented at the annual meeting of the Psychometric Society, 1998)

A hybrid method for controlling item exposure in computerized adaptive testing - Nering, M. L.; Davey, T.; Thompson, T. (Paper presented at the annual meeting of the Psychometric Society, 1998)

The impact of nonmodel-fitting responses in a realistic CAT environment - Yi, Q,; Nering, M. (Paper presented at the annual meeting of the National Council on Measurement in Education, 1998)

The impact of scoring flawed items on ability estimation in CAT - Liu, M.; Steffen, M. (Paper presented at the annual meeting of the Psychometric Society, 1998)

Innovations in computer-based ability testing: Promise, problems and perils - J. R. McBride (1998)

Item banking - Rudner, L. M. (Practical Assessment, Research and Evaluation, 1998)
Discusses the advantages and disadvantages of using item banks while providing useful information to those who are considering implementing an item banking project in their school district. The primary advantage of item banking is in test development. Also describes start-up activities in implementing item banking. (SLD)

Item development and pretesting in a computer-based testing environment - Parshall, C. G. (Paper presented at the Educational Testing Service Sponsored Colloquium on Computer-Based Testing: Building the Foundation for Future Assessments, 1998)

Item selection in adaptive testing with the sequential probability ratio test (Measurement and Research Department Report, 98-1) - Theo Eggen (1998)

Item selection in computerized adaptive testing: Should more discriminating items be used first? Paper presented at the annual meeting of the American Educational Research Association, San Diego, CA - Hau, K. T.; Chang, Hua-Hua (1998)

Item selection in computerized adaptive testing: Should more discriminating items be used first? - Hau, K. T.; Chang, Hua-Hua (Journal of Educational Measurement, 1998)

Maintaining content validity in computerized adaptive testing - Luecht, RM; de Champlain, A.; Nungester, R. J. (Advances in Health Sciences Education, 1998)
The authors empirically demonstrate some of the trade-offs which can occur when content balancing is imposed in computerized adaptive testing (CAT) forms or conversely, when it is ignored. The authors contend that the content validity of a CAT form can actually change across a score scale when content balancing is ignored. However they caution that, efficiency and score precision can be severely reduced by over specifying content restrictions in a CAT form. The results from 2 simulation studies are presented as a means of highlighting some of the trade-offs that could occur between content and statistical considerations in CAT form assembly. (PsycINFO Database Record (c) 2003 APA, all rights reserved).
Keywords: computerized adaptive testing

Measuring change conventionally and adaptively - May, K.; Nicewander, W. A. (Educational and Psychological Measurement, 1998)

A model for optimal constrained adaptive testing - van der Linden, W. J.; Reese, L. M. (Applied Psychological Measurement, 1998)
A model for constrained computerized adaptive testing is proposed in which the information in the test at the trait level (0) estimate is maximized subject to a number of possible constraints on the content of the test. At each item-selection step, a full test is assembled to have maximum information at the current 0 estimate, fixing the items already administered. Then the item with maximum in-formation is selected. All test assembly is optimal because a linear programming (LP) model is used that automatically updates to allow for the attributes of the items already administered and the new value of the 0 estimator. The LP model also guarantees that each adaptive test always meets the entire set of constraints. A simulation study using a bank of 753 items from the Law School Admission Test showed that the 0 estimator for adaptive tests of realistic lengths did not suffer any loss of efficiency from the presence of 433 constraints on the item selection process.
Keywords: computerized adaptive testing

A new approach for the detection of item preknowledge in computerized adaptive testing - McLeod, L. D.; Lewis, C. (Paper presented at the annual meeting of the Psychometric Society, 1998)

Nonmodel-fitting responses and robust ability estimation in a realistic CAT environment - Yi, Q,; Nering, M. (Paper presented at the annual meeting of the National Council on Measurement in Education, 1998)

Optimal design of item pools for computerized adaptive testing - Stocking, M. L.; Swanson, L. (Applied Psychological Measurement, 1998)

Optimal sequential rules for computer-based instruction - Vos, H. J. (Journal of Educational Computing Research, 1998)

Optimal test assembly of psychological and educational tests - van der Linden, W. J. (Applied Psychological Measurement, 1998)

Patterns of item exposure using a randomized CAT algorithm - Lunz, M. E.; Stahl, J. A. (Paper presented at the annual meeting of the National Council on Measurement in Education, 1998)

Person fit based on statistical process control in an adaptive testing environment (Research Report 98-13) - van Krimpen-Stoop, E. M. L. A.; Meijer, R. R. (1998)

Practical issues in computerized test assembly - Wightman, L. F. (Applied Psychological Measurement, 1998)

Properties of ability estimation methods in computerized adaptive testing - Wang, T.; Vispoel, W. P. (Journal of Educational Measurement, 1998)

Protecting the integrity of computerized testing item pools - Way, W. D. (Educational Measurement: Issues and Practice, 1998)

Psychometric characteristics of computer-adaptive and self-adaptive vocabulary tests: The role of answer feedback and test anxiety - Vispoel, W. P. (Journal of Educational Measurement, 1998)

Quality control of on-line calibration in computerized adaptive testing (Research Report 98-03) - Glas, C. A. W. (1998)

The relationship between computer familiarity and performance on computer-based TOEFL test tasks (Research Report 98-08) - Taylor, C.; Jamieson, J.; Eignor, D. R.; Kirsch, I. (1998)

Reviewing and changing answers on computer-adaptive and self-adaptive vocabulary tests - Vispoel, W. P. (Journal of Educational Measurement, 1998)

Simulating nonmodel-fitting responses in a CAT Environment (Research Report 98-10) - Yi, Q.; Nering, M, L. (1998)

Simulating the null distribution of person-fit statistics for conventional and adaptive tests (Research Report 98-02) - Meijer, R. R.; van Krimpen-Stoop, E. M. L. A. (1998)

Simulating the use of disclosed items in computerized adaptive testing - Stocking, M. L.; W. C. Ward; Potenza, M. T. (Journal of Educational Measurement, 1998)
Regular use of questions previously made available to the public (i.e., disclosed items) may provide one way to meet the requirement for large numbers of questions in a continuous testing environment, that is, an environment in which testing is offered at test taker convenience throughout the year rather than on a few prespecified test dates. First it must be shown that such use has effects on test scores small enough to be acceptable. In this study simulations are used to explore the use of disclosed items under a worst-case scenario which assumes that disclosed items are always answered correctly. Some item pool and test designs were identified in which the use of disclosed items produces effects on test scores that may be viewed as negligible.
Keywords: computerized adaptive testing

Some considerations for eliminating biases in ability estimation in computerized adaptive testing - Samejima, F. (Paper presented at the annual meeting of the American Educational Research Association, 1998)

Some item response theory to provide scale scores based on linear combinations of testlet scores, for computerized adaptive tests - Thissen, D. (Paper presented at the annual meeting of the Psychometric Society, 1998)

Some practical examples of computerized adaptive sequential testing - Luecht, RM; Nungester, R. J. (Journal of Educational Measurement, 1998)

Some reliability estimators for computerized adaptive tests - Nicewander, W. A.; Thomasson, G. L. (Paper presented at the annual meeting of the Psychometric Society, 1998)

Statistical tests for person misfit in computerized adaptive testing (Research Report 98-01) - Glas, C. A. W.; Meijer, R. R.; van Krimpen-Stoop, E. M. L. A. (1998)

Statistical tests for person misfit in computerized adaptive testing - Glas, C. A. W.; Meijer, R. R.; van Krimpen-Stoop, E. M. (Faculty of Educational Science and Technology, Univeersity of Twente, 1998)

Stochastic order in dichotomous item response models for fixed, adaptive, and multidimensional tests - van der Linden, W. J. (Psychometrika, 1998)

Swedish Enlistment Battery: Construct validity and latent variable estimation of cognitive abilities by the CAT-SEB - Mardberg, B.; Carlstedt, B. (International Journal of Selection and Assessment, 1998)

Test development exposure control for adaptive testing - Parshall, C. G.; Davey, T.; Nering, M. L. (Paper presented at the annual meeting of the National Council on Measurement in Education, 1998)

Testing word knowledge by telephone to estimate general cognitive aptitude using an adaptive test - Legree, P. J.; Fischl, M. A; Gade, P. A.; Wilson, M. (Intelligence, 1998)

Three response types for broadening the conception of mathematical problem solving in computerized-adaptive tests (Research Report 98-45) - Bennett, R. E.; Morley, M.; Quardt, D. (1998)

Using response-time constraints to control for differential speededness in adaptive testing (Research Report 98-06) - van der Linden, W. J.; Scrams, D. J.; Schnipke, D. L. (1998)

The accuracy of examinee judgments of relative item difficulty: Implication for computerized adaptive testing - Wise, S. L.; Freeman, S.A.; Finney, S. J.; Enders, C. K.; Severance, D.D. (Paper presented at the annual meeting of the National Council on Measurement in Education, 1997)

Adapting to adaptive testing - Overton, R. C.; Harms, H. J.; Taylor, L. R.; Zickar, M.. J. (Personnel Psychology, 1997)

Administering and scoring the computerized adaptive testing - A Zara (Paper presented at the annual meeting of the National Council on Measurement in Education, 1997)

Alternate methods of scoring computer-based adaptive tests - Green, B. F. (Paper presented at the annual meeting of the National Council on Measurement in Education, 1997)

An alternative method for scoring adaptive tests - Stocking, M. L. (Journal of Educational and Behavioral Statistics, 1997)

Applications of Bayesian decision theory to sequential mastery testing (Research Report 97-06) - Vos, H. J. (1997)

Applications of multidimensional adaptive testing - Segall, D. O. (Paper presented at the annual meeting of the National Council on Measurement in Education, 1997)

Assessing speededness in variable-length computer-adaptive tests - Bontempo, B; Julian, E. R; Gorham, J. L. (Paper presented at the annual meeting of the National Council on Measurement in Education, 1997)

A Bayesian enhancement of Mantel Haenszel DIF analysis for computer adaptive tests - Zwick, R. (Paper presented at the annual meeting of the National Council on Measurement in Education, 1997)

Calibration of CAT items administered online for classification: Assumption of local independence - Spray, J. A.; Parshall, C. G.; Huang, C.-H. (Paper presented at the annual meeting of the Psychometric Society, 1997)

CAST 5 for Windows users' guide - J. R. McBride; Cooper, R. R (1997)

CAT-ASVAB cost and benefit analyses - Wise, L. L.; Curran, L. T.; J. R. McBride (1997)

CAT-ASVAB operational test and evaluation - Moreno, K. E. (1997)

CATSIB: A modified SIBTEST procedure to detect differential item functioning in computerized adaptive tests (Research report) - Nandakumar, R.; Roussos, L. (1997)

Comparability and validity of computerized adaptive testing with the MMPI-2 using a clinical sample - Handel, R. W.; Ben-Porath, Y. S.; Watt, M. (Paper presented at the 32nd Annual Symposium and Recent Developments in the use of the MMPI-2 and MMPI-A. Minneapolis MN., 1997)

A comparison of maximum likelihood estimation and expected a posteriori estimation in computerized adaptive testing using the generalized partial credit model - Chen, S-K. (Dissertation Abstracts International: Section B: the Sciences & Engineering, 1997)
A simulation study was conducted to investigate the application of expected a posteriori (EAP) trait estimation in computerized adaptive tests (CAT) based on the generalized partial credit model (Muraki, 1992), and to compare the performance of EAP with maximum likelihood trait estimation (MLE). The performance of EAP was evaluated under different conditions: the number of quadrature points (10, 20, and 30), and the type of prior distribution (normal, uniform, negatively skewed, and positively skewed). The relative performance of the MLE and EAP estimation methods were assessed under two distributional forms of the latent trait, one normal and the other negatively skewed. Also, both the known item parameters and estimated item parameters were employed in the simulation study. Descriptive statistics, correlations, scattergrams, accuracy indices, and audit trails were used to compare the different methods of trait estimation in CAT. The results showed that, regardless of the latent trait distribution, MLE and EAP with a normal prior, a uniform prior, or the prior that matches the latent trait distribution using either 20 or 30 quadrature points provided relatively accurate estimation in CAT based on the generalized partial credit model. However, EAP using only 10 quadrature points did not work well in the generalized partial credit CAT. Also, the study found that increasing the number of quadrature points from 20 to 30 did not increase the accuracy of EAP estimation. Therefore, it appears 20 or more quadrature points are sufficient for accurate EAP estimation. The results also showed that EAP with a negatively skewed prior and positively skewed prior performed poorly for the normal data set, and EAP with positively skewed prior did not provide accurate estimates for the negatively skewed data set. Furthermore, trait estimation in CAT using estimated item parameters produced results similar to those obtained using known item parameters. In general, when at least 20 quadrature points are used, EAP estimation with a normal prior, a uniform prior or the prior that matches the latent trait distribution appears to be a good alternative to MLE in the application of polytomous CAT based on the generalized partial credit model. (PsycINFO Database Record (c) 2003 APA, all rights reserved).
Keywords: computerized adaptive testing

A comparison of testlet-based test designs for computerized adaptive testing - Schnipke, D. L.; Reese, L. M. (Paper presented at the meeting of American Educational Research Association, 1997)

Computer assembly of tests so that content reigns supreme - Case, S. M.; Luecht, RM (Paper presented at the annual meeting of the National Council on Measurement in Education, 1997)

Computer-adaptive testing of listening comprehension: A blueprint of CAT Development - Dunkel, P. A. (The Language Teacher Online 21, 1997)

Computerized adaptive and fixed-item testing of music listening skill: A comparison of efficiency, precision, and concurrent validity - Vispoel, W. P.,; Wang, T. (Journal of Educational Measurement, 1997)

Computerized adaptive and fixed-item testing of music listening skill: A comparison of efficiency, precision, and concurrent validity - Vispoel, W. P.; Wang, T.; Bleiler, T. (Journal of Educational Measurement, 1997)

Computerized adaptive testing: From inquiry to operation - Sands, W. A.; B. K. Waters; J. R. McBride (American Psychological Association, 1997)
(from the cover) This book traces the development of computerized adaptive testing (CAT) from its origins in the 1960s to its integration with the Armed Services Vocational Aptitude Battery (ASVAB) in the 1990s. A paper-and-pencil version of the battery (P&P-ASVAB) has been used by the Defense Department since the 1970s to measure the abilities of applicants for military service. The test scores are used both for initial qualification and for classification into entry-level training opportunities. /// This volume provides the developmental history of the CAT-ASVAB through its various stages in the Joint-Service arena. Although the majority of the book concerns the myriad technical issues that were identified and resolved, information is provided on various political and funding support challenges that were successfully overcome in developing, testing, and implementing the battery into one of the nation's largest testing programs. The book provides useful information to professionals in the testing community and everyone interested in personnel assessment and evaluation. (PsycINFO Database Record (c) 2004 APA, all rights reserved).
Keywords: computerized adaptive testing

A computerized adaptive testing system for speech discrimination measurement: The Speech Sound Pattern Discrimination Test - Bochner, J.; Garrison, W.; Palmer, L.; MacKenzie, D.; Braveman, A. (Journal of the Accoustical Society of America, 1997)
A computerized, adaptive test-delivery system for the measurement of speech discrimination, the Speech Sound Pattern Discrimination Test, is described and evaluated. Using a modified discrimination task, the testing system draws on a pool of 130 items spanning a broad range of difficulty to estimate an examinee's location along an underlying continuum of speech processing ability, yet does not require the examinee to possess a high level of English language proficiency. The system is driven by a mathematical measurement model which selects only test items which are appropriate in difficulty level for a given examinee, thereby individualizing the testing experience. Test items were administered to a sample of young deaf adults, and the adaptive testing system evaluated in terms of respondents' sensory and perceptual capabilities, acoustic and phonetic dimensions of speech, and theories of speech perception. Data obtained in this study support the validity, reliability, and efficiency of this test as a measure of speech processing ability.
Keywords: *Diagnosis, Computer-Assisted; *Speech Discrimination Tests; *Speech Perception; Adolescent; Adult; Audiometry, Pure-Tone; Human; Middle Age; Psychometrics; Reproducibility of Results

Computerized adaptive testing through the World Wide Web - Shermis, M. D. (1997)

Computerized adaptive testing through the World Wide Web - Shermis, M. D.; Mzumara, H.; Brown, M.; Lillig, C. (1997)

Computerized adaptive testing using the partial credit model for attitude measurement - Baek, S. G. (1997)

Controlling test and computer anxiety: Test performance under CAT and SAT conditions - Shermis, M. D.; Mzumara, H.; Bublitz, S. (Paper presented at the annual meeting of the National Council on Measurement in Education, 1997)

Current and future challenges - Segall, D. O.; Moreno, K. E. (1997)

Detecting misbehaving items in a CAT environment - Swygert, K. (Paper presented at the annual meeting of the National Council on Measurement in Education, 1997)

Detection of aberrant response patterns in CAT - van der Linden, W. J. (Paper presented at the annual meeting of the National Council on Measurement in Education, 1997)

Developing and scoring an innovative computerized writing assessment - Davey, T.; Godwin, J.,; Mittelholz, D. (Journal of Educational Measurement, 1997)

Diagnostic adaptive testing: Effects of remedial instruction as empirical validation - Tatsuoka, K. K.; Tatsuoka, M. M. (Journal of Educational Measurement, 1997)

The distribution of indexes of person fit within the computerized adaptive testing environment - Nering, M. L. (Applied Psychological Measurement, 1997)
The extent to which a trait estimate represents the underlying latent trait of interest can be estimated by using indexes of person fit. Several statistical methods for indexing person fit have been proposed to identify nonmodel-fitting response vectors. These person-fit indexes have generally been found to follow a standard normal distribution for conventionally administered tests. The present investigation found that within the context of computerized adaptive testing (CAT) these indexes tended not to follow a standard normal distribution. As the item pool became less discriminating, as the CAT termination criterion became less stringent, and as the number of items in the pool decreased, the distributions of the indexes approached a standard normal distribution. It was determined that under these conditions the indexes' distributions approached standard normal distributions because more items were being administered. However, even when over 50 items were administered in a CAT the indexes were distributed in a fashion that was different from what was expected. (PsycINFO Database Record (c) 2006 APA )
Keywords: Adaptive Testing; Computer Assisted Testing; Fit; Person Environment

The effect of adaptive administration on the variability of the Mantel-Haenszel measure of differential item functioning - Zwick, R. (Educational and Psychological Measurement, 1997)

The effect of population distribution and method of theta estimation on computerized adaptive testing (CAT) using the rating scale model - Chen, S-K.; Hou, L. Y.; Fitzpatrick, S. J.; Dodd, B. G. (Educational & Psychological Measurement, 1997)
Investigated the effect of population distribution on maximum likelihood estimation (MLE) and expected a posteriori estimation (EAP) in a simulation study of computerized adaptive testing (CAT) based on D. Andrich's (1978) rating scale model. Comparisons were made among MLE and EAP with a normal prior distribution and EAP with a uniform prior distribution within 2 data sets: one generated using a normal trait distribution and the other using a negatively skewed trait distribution. Descriptive statistics, correlations, scattergrams, and accuracy indices were used to compare the different methods of trait estimation. The EAP estimation with a normal prior or uniform prior yielded results similar to those obtained with MLE, even though the prior did not match the underlying trait distribution. An additional simulation study based on real data suggested that more work is needed to determine the optimal number of quadrature points for EAP in CAT based on the rating scale model. The choice between MLE and EAP for particular measurement situations is discussed. (PsycINFO Database Record (c) 2003 APA, all rights reserved).
Keywords: computerized adaptive testing

The effect of population distribution and methods of theta estimation on computerized adaptive testing (CAT) using the rating scale model - Chen, S.; Hou, L.; Fitzpatrick, S. J.; Dodd, B. (Educational and Psychological Measurement, 1997)

The effects of motivation on equating adaptive and conventional tests - Segall, D. O. (Paper presented at the annual meeting of the National Council on Measurement in Education, 1997)

Equating the CAT-ASVAB - Segall, D. O. (1997)

Essentially unbiased EAP estimates in computerized adaptive testing - Wang, T. (Paper presented at the annual meeting of the American Educational Research Association, 1997)

Evaluating an automatically scorable, open-ended response type for measuring mathematical reasoning in computer-adaptive tests - Bennett, R. E.; Steffen, M.; Singley, M.K.; Morley, M.; Jacquemin, D. (1997)

Evaluating comparability in computerized adaptive testing: A theoretical framework with an example - Wang, T.; Kolen, M. J. (Paper presented at the annual meeting of the American Educational Research Association, 1997)

Evaluating item calibration medium in computerized adaptive testing - Hetter, R. D.; Segall, D. O.; Bloxom, B. M. (1997)

Examinee issues in CAT - Wise, S. L. (Paper presented at the annual meeting of the National Council on Measurement in Education, 1997)

Flawed items in computerized adaptive testing - Potenza, M. T.; Stocking, M. L. (Journal of Educational Measurement, 1997)

Getting more precision on computer adaptive testing - Krass, I. A. (Paper presented at the 62nd Annual meeting of Psychometric Society, 1997)

The goal of equity within and between computerized adaptive tests and paper and pencil forms. - Thomasson, G. L. (Paper presented at the annual meeting of the National Council on Measurement in Education, 1997)

Health status assessment for the twenty-first century: item response theory, item banking and computer adaptive testing - Revicki, D. A.; Cella, D. F. (Quality of Life Research, 1997)
Health status assessment is frequently used to evaluate the combined impact of human immunodeficiency virus (HIV) disease and its treatment on functioning and well-being from the patient's perspective. No single health status measure can efficiently cover the range of problems in functioning and well-being experienced across HIV disease stages. Item response theory (IRT), item banking and computer adaptive testing (CAT) provide a solution to measuring health-related quality of life (HRQoL) across different stages of HIV disease. IRT allows us to examine the response characteristics of individual items and the relationship between responses to individual items and the responses to each other item in a domain. With information on the response characteristics of a large number of items covering a HRQoL domain (e.g. physical function, and psychological well-being), and information on the interrelationships between all pairs of these items and the total scale, we can construct more efficient scales. Item banks consist of large sets of questions representing various levels of a HRQoL domain that can be used to develop brief, efficient scales for measuring the domain. CAT is the application of IRT and item banks to the tailored assessment of HRQoL domains specific to individual patients. Given the results of IRT analyses and computer-assisted test administration, more efficient and brief scales can be used to measure multiple domains of HRQoL for clinical trials and longitudinal observational studies.
Keywords: *Health Status; *HIV Infections/diagnosis; *Quality of Life; Diagnosis, Computer-Assisted; Disease Progression; Humans; Psychometrics/*methods

Identifying similar item content clusters on multiple test forms - Reckase, M. D.; Thompson, T.D.; Nering, M. (Paper presented at the Psychometric Society meeting, 1997)

Improving the quality of music aptitude tests through adaptive administration of items - Vispoel, W. P. (Paper presented at Multidisciplinary Perspectives on Musicality: The Seashore Symposium, 1997)

Incorporating content constraints into a multi-stage adaptive testlet design: LSAC report - Reese, L. M.; Schnipke, D. L.; Luebke, S. W. (1997)

Incorporating decision consistency into Bayesian sequential testing - Smith, R.; Lewis, C. (Paper presented at the annual meeting of National Council on Measurement in Education, 1997)

An investigation of self-adapted testing in a Spanish high school population - Ponsoda, V.; Wise, S. L.; Olea, J.; Revuelta, J. (Educational and Psychological Measurement, 1997)

Item exposure control in CAT-ASVAB - Hetter, R. D.; Sympson, J. B. (Computerized adaptive testing: From inquiry to operation, 1997)
Describes the method used to control item exposure in computerized adaptive testing-Armed Services Vocational Aptitude Battery (CAT-ASVAB). The method described was developed specifically to ensure that CAT-ASVAB items were expose no more often than the items in the printers ASVAB's alternate forms, ensuring that CAT ASVAB is nor more vulnerable than printed ASVAB forms to comprise from item exposure. (PsycINFO Database Record (c) 2010 APA, all rights reserved)

Item pool development and evaluation - Segall, D. O.; Moreno, K. E.; Hetter, D. H. (1997)

Item pool development and maintenance - Kingsbury, G. G. (Paper presented at the annual meeting of the National Council on Measurement in Education, 1997)

Linking scores for computer-adaptive and paper-and-pencil administrations of the SAT (Research Report No 97-12) - Lawrence, I.; Feigenbaum, M. (1997)

Maintaining a CAT item pool with operational data - Levine, M. L.; Segall, D. O.; Williams, B. A. (Paper presented at the annual meeting of the National Council on Measurement in Education, 1997)

Maintaining item and test security in a CAT environment: A simulation study - Patsula, L N.; Steffen, M. (Paper presented at the annual meeting of the National Council on Measurement in Education, 1997)

Mathematical programming approaches to computerized adaptive testing - Jones, D. H. (Paper presented at the annual meeting of the National Council on Measurement in Education, 1997)

A minimax sequential procedure in the context of computerized adaptive mastery testing (Research Report 97-07) - Vos, H. J. (1997)

Modification of the Computerized Adaptive Screening Test (CAST) for use by recruiters in all military services - J. R. McBride; Cooper, R. R (1997)

Multidimensional adaptive testing with a minimum error-variance criterion (Research Report 97-03) - van der Linden, W. J. (1997)

Multidimensional adaptive testing with a minimum error-variance criterion - van der Linden, W. J. (Paper presented at the annual meeting of the American Educational Research Association, 1997)

Multi-stage CAT with stratified design - Chang, Hua-Hua; Ying, Z. (Paper presented at the annual meeting of the Psychometric Society. Gatlinburg TN., 1997)

Nonlinear sequential designs for logistic item response theory models with applications to computerized adaptive tests - Chang, Hua-Hua; Ying, Z. (The Annals of Statistics., 1997)

On-line performance assessment using rating scales - Stahl, J.; Shumway, R.; Bergstrom, B.; Fisher, A. (Journal of Outcomes Measurement, 1997)
The purpose of this paper is to report on the development of the on-line performance assessment instrument--the Assessment of Motor and Process Skills (AMPS). Issues that will be addressed in the paper include: (a) the establishment of the scoring rubric and its implementation in an extended Rasch model, (b) training of raters, (c) validation of the scoring rubric and procedures for monitoring the internal consistency of raters, and (d) technological implementation of the assessment instrument in a computerized program.
Keywords: *Outcome Assessment (Health Care); *Rehabilitation; *Software; *Task Performance and Analysis; Activities of Daily Living; Humans; Microcomputers; Psychometrics; Psychomotor Performance

Optimization methods in computerized adaptive testing - Cordova, M. J. (1997)

Overview of practical issues in a CAT program - Wise, S. L. (Paper presented at the annual meeting of the National Council on Measurement in Education, 1997)

An overview of the LSAC CAT research agenda - Pashley, P. (Paper presented at the annual meeting of the National Council on Measurement in Education, 1997)

Overview of the USMLE Step 2 computerized field test - Luecht, RM; Nungester, R. J. (Paper presented at the annual meeting of the National Council on Measurement in Education, 1997)

Policy and program management perspective - Martin, C.J.; Hoshaw, C.R. (1997)

Preliminary psychometric research for CAT-ASVAB: Selecting an adaptive testing strategy - J. R. McBride; Wetzel, C. D.; Hetter, R. D. (1997)

Protecting the integrity of the CAT item pool - Way, W. D. (Paper presented at the annual meeting of the National Council on Measurement in Education, 1997)

Psychometric mode effects and fit issues with respect to item difficulty estimates - Hadidi, A.; Luecht, RM (Paper presented at the annual meeting of the National Council on Measurement in Education, 1997)

Psychometric procedures for administering CAT-ASVAB - Segall, D. O.; Moreno, K. E.; Bloxom, B. M.; Hetter, R. D. (1997)

Realistic simulation procedures for item response data - Davey, T.; Nering, M.; Thompson, T. (In T. Miller (Chair), High-dimensional simulation of item response data for CAT research. Psychometric Society, 1997)

Relationship of response latency to test design, examinee ability, and item difficulty in computer-based test administration - Swanson, D. B.; Featherman, C. M.; Case, A. M.; Luecht, RM; Nungester, R. (Paper presented at the annual meeting of the National Council on Measurement in Education, 1997)

Reliability and construct validity of CAT-ASVAB - Moreno, K. E.; Segall, O. D. (1997)

Research antecedents of applied adaptive testing - J. R. McBride (Computerized adaptive testing: From inquiry to practice, 1997)
(from the chapter) This chapter sets the stage for the entire computerized adaptive testing Armed Services Vocational Aptitude Battery (CAT-ASVAB) development program by describing the state of the art immediately preceding its inception. By the mid-l970s, a great deal of research had been conducted that provided the technical underpinnings needed to develop adaptive tests, but little research had been done to corroborate empirically the promising results of theoretical analyses and computer simulation studies. In this chapter, the author summarizes much of the important theoretical and simulation research prior to 1977. In doing so, he describes a variety of approaches to adaptive testing, and shows that while many methods for adaptive testing had been proposed, few practical attempts had been made to implement it. Furthermore, the few instances of adaptive testing were based primarily on traditional test theory, and were developed in laboratory settings for purposes of basic research. The most promising approaches, those based on item response theory and evaluated analytically or by means of computer simulations, remained to be proven in the crucible of live testing. (PsycINFO Database Record (c) 2004 APA, all rights reserved).
Keywords: computerized adaptive testing

Revising item responses in computerized adaptive tests: A comparison of three models - Stocking, M. L. (Applied Psychological Measurement, 1997)
Interest in the application of large-scale computerized adaptive testing has focused attention on issues that arise when theoretical advances are made operational. One such issue is that of the order in which exaniinees address questions within a test or separately timed test section. In linear testing, this order is entirely under the control of the examinee, who can look ahead at questions and return and revise answers to questions. Using simulation, this study investigated three models that permit restricted examinee control over revising previous answers in the context of adaptive testing. Even under a worstcase model of examinee revision behavior, two of the models of permitting item revisions worked well in preserving test fairness and accuracy. One model studied may also preserve some cognitive processing styles developed by examinees for a linear testing environment.
Keywords: computerized adaptive testing

The role of item feedback in self-adapted testing - Roos, L. L.; Wise, S. L.; Plake, B. S. (Educational and Psychological Measurement, 1997)

Self-adapted testing: Improving performance by modifying tests instead of examinees - Rocklin, T. (Stress & Coping: An International Journal, 1997)
This paper describes self-adapted testing and some of the evidence concerning its effects, presents possible theoretical explanations for those effects, and discusses some of the practical concerns regarding self-adapted testing. Self-adapted testing is a variant of computerized adapted testing in which the examine makes dynamic choices about the difficulty of the items he or she attempts. Self-adapted testing generates scores that are, in constrast to computerized adapted test and fixed-item tests, uncorrelated with a measure of trait test anxiety. This lack of correlation with an irrelevant attribute of the examine is evidence of an improvement in the construct validity of the scores. This improvement comes at the cost of a decrease in testing efficiency. The interaction between test anxiety and test administration mode is more consistent with an interference theory of test anxiety than a deficit theory. Some of the practical concerns regarding self-adapted testing can be ruled out logically, but others await empirical investigation.

Simulating the use of disclosed items in computerized adaptive testing (Research Report 97-10) - Stocking, M. L.; W. C. Ward; Potenza, M. T. (1997)

Simulation of realistic ability vectors - Nering, M.; Thompson, T.D.; Davey, T. (Paper presented at the Psychometric Society meeting, 1997)

A simulation study of the use of the Mantel-Haenszel and logistic regression procedures for assessing DIF in a CAT environment - Ross, L. P.; Nandakumar, R,; Clauser, B. E. (Paper presented at the annual meeting of the National Council on Measurement in Education, 1997)

Some new item selection criteria for adaptive testing - Berger, M. P. F.,; Veerkamp, W. J. J. (Journal of Educational and Behavioral Statistics, 1997)

Some new item selection criteria for adaptive testing - Veerkamp, W. J. J.,; Berger, M. P. F. (Journal of Educational and Behavioral Statistics, 1997)

Some questions that must be addressed to develop and maintain an item pool for use in an adaptive test - Kingsbury, G. G. (Paper presented at the annual meeting of the National Council on Measurement in Education, 1997)