%0 Book Section %B Elements of Adaptive Testing %D 2010 %T Principles of Multidimensional Adaptive Testing %A Segall, D. O. %B Elements of Adaptive Testing %P 57-76 %G eng %& 3 %R 10.1007/978-0-387-85461-8 %0 Book Section %D 2009 %T The nine lives of CAT-ASVAB: Innovations and revelations %A Pommerich, M %A Segall, D. O. %A Moreno, K. E. %X The Armed Services Vocational Aptitude Battery (ASVAB) is administered annually to more than one million military applicants and high school students. ASVAB scores are used to determine enlistment eligibility, assign applicants to military occupational specialties, and aid students in career exploration. The ASVAB is administered as both a paper-and-pencil (P&P) test and a computerized adaptive test (CAT). CAT-ASVAB holds the distinction of being the first large-scale adaptive test battery to be administered in a high-stakes setting. Approximately two-thirds of military applicants currently take CAT-ASVAB; long-term plans are to replace P&P-ASVAB with CAT-ASVAB at all test sites. Given CAT-ASVAB’s pedigree—approximately 20 years in development and 20 years in operational administration—much can be learned from revisiting some of the major highlights of CATASVAB history. This paper traces the progression of CAT-ASVAB through nine major phases of development including: research and evelopment of the CAT-ASVAB prototype, the initial development of psychometric procedures and item pools, initial and full-scale operational implementation, the introduction of new item pools, the introduction of Windows administration, the introduction of Internet administration, and research and development of the next generation CATASVAB. A background and history is provided for each phase, including discussions of major research and operational issues, innovative approaches and practices, and lessons learned. %C In D. J. Weiss (Ed.), Proceedings of the 2009 GMAC Conference on Computerized Adaptive Testing. %G eng %0 Book Section %D 2004 %T Computerized adaptive testing %A Segall, D. O. %C Encyclopedia of social measurement. Academic Press. %G eng %0 Journal Article %J Journal of Educational and Behavioral Statistics %D 2004 %T A sharing item response theory model for computerized adaptive testing %A Segall, D. O. %X A new sharing item response theory (SIRT) model is presented which explicitly models the effects of sharing item content between informants and testtakers. This model is used to construct adaptive item selection and scoring rules that provide increased precision and reduced score gains in instances where sharing occurs. The adaptive item selection rules are expressed as functions of the item’s exposure rate in addition to other commonly used properties (characterized by difficulty, discrimination, and guessing parameters). Based on the results of simulated item responses, the new item selection and scoring algorithms compare favorably to the Sympson-Hetter exposure control method. The new SIRT approach provides higher reliability and lower score gains in instances where sharing occurs. %B Journal of Educational and Behavioral Statistics %V 29 %P 439-460 %8 Win %G eng %0 Conference Paper %B Paper presented at the Annual meeting of the National Council on Measurement in Education %D 2003 %T An adaptive exposure control algorithm for computerized adaptive testing using a sharing item response theory model %A Segall, D. O. %B Paper presented at the Annual meeting of the National Council on Measurement in Education %C Chicago IL %G eng %0 Conference Paper %B Paper presented at the Annual meeting of the National Council on Measurement in Education %D 2003 %T Calibrating CAT item pools and online pretest items using MCMC methods %A Segall, D. O. %B Paper presented at the Annual meeting of the National Council on Measurement in Education %C Chicago IL %G eng %0 Conference Paper %B Paper presented at the annual meeting of the National Council on Measurement in Education %D 2003 %T Calibrating CAT pools and online pretest items using marginal maximum likelihood methods %A Pommerich, M %A Segall, D. O. %B Paper presented at the annual meeting of the National Council on Measurement in Education %C Chicago IL %G eng %0 Conference Paper %B Paper presented at the annual meeting of the National Council on Measurement in Education %D 2002 %T Confirmatory item factor analysis using Markov chain Monte Carlo estimation with applications to online calibration in CAT %A Segall, D. O. %B Paper presented at the annual meeting of the National Council on Measurement in Education %C New Orleans, LA %G eng %0 Journal Article %J Journal of Educational and Behavioral Statistics %D 2002 %T An item response model for characterizing test compromise %A Segall, D. O. %K computerized adaptive testing %X This article presents an item response model for characterizing test-compromise that enables the estimation of item-preview and score-gain distributions observed in on-demand high-stakes testing programs. Model parameters and posterior distributions are estimated by Markov Chain Monte Carlo (MCMC) procedures. Results of a simulation study suggest that when at least some of the items taken by a small sample of test takers are known to be secure (uncompromised), the procedure can provide useful summaries of test-compromise and its impact on test scores. The article includes discussions of operational use of the proposed procedure, possible model violations and extensions, and application to computerized adaptive testing. %B Journal of Educational and Behavioral Statistics %V 27 %P 163-179 %G eng %0 Conference Paper %B Paper presented at the annual meeting of the National Council on Measurement in Education %D 2001 %T Measuring test compromise in high-stakes computerized adaptive testing: A Bayesian Strategy for surrogate test-taker detection %A Segall, D. O. %B Paper presented at the annual meeting of the National Council on Measurement in Education %C Seattle WA %G eng %0 Book Section %D 2000 %T Principles of multidimensional adaptive testing %A Segall, D. O. %C W. J. van der Linden and C. A. W. Glas (Eds.), Computerized adaptive testing: Theory and practice (pp. 53-73). Norwell MA: Kluwer. %G eng %0 Book Section %D 1999 %T Development of the computerized adaptive testing version of the Armed Services Vocational Aptitude Battery %A Segall, D. O. %A Moreno, K. E. %C F. Drasgow and J. Olson-Buchanan (Eds.). Innovations in computerized assessment. Mahwah NJ: Erlbaum. %G eng %0 Conference Paper %B Paper presented at the annual meeting of the National Council on Measurement in Education %D 1999 %T Reducing item exposure without reducing precision (much) in computerized adaptive testing %A Holmes, R. M. %A Segall, D. O. %B Paper presented at the annual meeting of the National Council on Measurement in Education %C Montreal, CA %G eng %0 Conference Paper %B Paper presented at the annual meeting of the National Council on Measurement in Education %D 1997 %T Applications of multidimensional adaptive testing %A Segall, D. O. %B Paper presented at the annual meeting of the National Council on Measurement in Education %C Montreal, Canada %G eng %0 Book Section %D 1997 %T Current and future challenges %A Segall, D. O. %A Moreno, K. E. %C W. A. Sands, B. K. Waters, and J. R. McBride (Eds.). Computerized adaptive testing: From inquiry to operation (pp 257-269). Washington DC: American Psychological Association. %G eng %0 Conference Paper %B Paper presented at the annual meeting of the National Council on Measurement in Education %D 1997 %T The effects of motivation on equating adaptive and conventional tests %A Segall, D. O. %B Paper presented at the annual meeting of the National Council on Measurement in Education %C Chicago IL %G eng %0 Book Section %D 1997 %T Equating the CAT-ASVAB %A Segall, D. O. %C W. A. Sands, B. K. Waters, and J. R. McBride (Eds.), Computerized adaptive testing: From inquiry to operation (pp. 181-198). Washington DC: American Psychological Association. %G eng %0 Book Section %D 1997 %T Evaluating item calibration medium in computerized adaptive testing %A Hetter, R. D. %A Segall, D. O. %A Bloxom, B. M. %C W.A. Sands, B.K. Waters and J.R. McBride, Computerized adaptive testing: From inquiry to operation (pp. 161-168). Washington, DC: American Psychological Association. %G eng %0 Book Section %D 1997 %T Item pool development and evaluation %A Segall, D. O. %A Moreno, K. E. %A Hetter, D. H. %C W. A. Sands, B. K. Waters, and J. R. McBride (Eds.), Computerized adaptive testing: From inquiry to operation (pp. 117-130). Washington DC: American Psychological Association. %G eng %0 Conference Paper %B Paper presented at the annual meeting of the National Council on Measurement in Education %D 1997 %T Maintaining a CAT item pool with operational data %A Levine, M. L. %A Segall, D. O. %A Williams, B. A. %B Paper presented at the annual meeting of the National Council on Measurement in Education %C Chicago IL %G eng %0 Book Section %D 1997 %T Psychometric procedures for administering CAT-ASVAB %A Segall, D. O. %A Moreno, K. E. %A Bloxom, B. M. %A Hetter, R. D. %C W. A. Sands, B. K. Waters, and J. R. McBride (Eds.), Computerized adaptive testing: From inquiry to operation (pp. 131-140). Washington D.C.: American Psychological Association. %G eng %0 Book Section %D 1997 %T Validation of the experimental CAT-ASVAB system %A Segall, D. O. %A Moreno, K. E. %A Kieckhaefer, W. F. %A Vicino, F. L. %A J. R. McBride %C W. A. Sands, B. K. Waters, and J. R. McBride (Eds.), Computerized adaptive testing: From inquiry to operation. Washington, DC: American Psychological Association. %G eng %0 Journal Article %J Psychometrika %D 1996 %T Multidimensional adaptive testing %A Segall, D. O. %B Psychometrika %V 61 %P 331-354 %G eng %0 Journal Article %J Psychometrika %D 1996 %T Multidimensional adaptive testing %A Segall, D. O. %X Maximum likelihood and Bayesian procedures for item selection and scoring of multidimensional adaptive tests are presented. A demonstration using simulated response data illustrates that multidimensional adaptive testing (MAT) can provide equal or higher reliabilities with about one-third fewer items than are required by one-dimensional adaptive testing (OAT). Furthermore, holding test-length constant across the MAT and OAT approaches, substantial improvements in reliability can be obtained from multidimensional assessment. A number of issues relating to the operational use of multidimensional adaptive testing are discussed. %B Psychometrika %V 61 %P 331-354 %G eng %M 1996-04751-008 %0 Conference Paper %B Paper presented at the meeting of the Society for Industrial and Organizational Psychology %D 1995 %T The effects of item compromise on computerized adaptive test scores %A Segall, D. O. %B Paper presented at the meeting of the Society for Industrial and Organizational Psychology %C Orlando, FL %G eng %0 Conference Paper %B Paper presented at the meeting of the National Council on Measurement in Education %D 1995 %T Equating the CAT-ASVAB: Experiences and lessons learned %A Segall, D. O. %B Paper presented at the meeting of the National Council on Measurement in Education %C San Francisco %G eng %0 Conference Paper %B Paper presented at the meeting of the National Council on Measurement in Education %D 1995 %T Equating the CAT-ASVAB: Issues and approach %A Segall, D. O. %A Carter, G. %B Paper presented at the meeting of the National Council on Measurement in Education %C San Francisco %G eng %0 Conference Paper %B Paper presented at the annual meeting of the Psychometric Society %D 1995 %T Some new methods for content balancing adaptive tests %A Segall, D. O. %A Davey, T. C. %B Paper presented at the annual meeting of the Psychometric Society %C Minneapolis MN %G eng %0 Generic %D 1994 %T CAT-GATB simulation studies %A Segall, D. O. %C San Diego CA: Navy Personnel Research and Development Center %G eng %0 Journal Article %J Applied Psychological Measurement %D 1994 %T A Comparison of Item Calibration Media in Computerized Adaptive Testing %A Hetter, R. D. %A Segall, D. O. %A Bloxom, B. M. %B Applied Psychological Measurement %V 18 %G English %N 3 %0 Journal Article %J Applied Psychological Measurement %D 1994 %T A comparison of item calibration media in computerized adaptive tests %A Hetter, R. D. %A Segall, D. O. %A Bloxom, B. M. %B Applied Psychological Measurement %V 18 %P 197-204 %G eng %0 Generic %D 1993 %T Item Calibration: Medium-of-administration effect on computerized adaptive scores (TR-93-9) %A Hetter, R. D. %A Bloxom, B. M. %A Segall, D. O. %C Navy Personnel Research and Development Center %G eng %0 Journal Article %J Proceedings of the 34th Annual Conference of the Military Testing Association %D 1992 %T CAT-ASVAB precision %A Moreno, K. E., %A Segall, D. O. %B Proceedings of the 34th Annual Conference of the Military Testing Association %V 1 %P 22-26 %G eng %0 Generic %D 1988 %T A procedure for scoring incomplete adaptive tests in high stakes testing %A Segall, D. O. %C Unpublished manuscript. San Diego, CA: Navy Personnel Research and Development Center %G eng %0 Conference Paper %B Proceedings of the 27th Annual Conference of the Military Testing Association %D 1985 %T A validity study of the computerized adaptive testing version of the Armed Services Vocational Aptitude Battery %A Moreno, K. E. %A Segall, D. O. %A Kieckhaefer, W. F. %B Proceedings of the 27th Annual Conference of the Military Testing Association %G eng