TY - CHAP T1 - Optimizing item exposure control algorithms for polytomous computerized adaptive tests with restricted item banks Y1 - 2009 A1 - Chajewski, M. A1 - Lewis, C. CY - D. J. Weiss (Ed.), Proceedings of the 2009 GMAC Conference on Computerized Adaptive Testing. N1 - {PDF File, 923 KB} ER - TY - CHAP T1 - Some thoughts on controlling item exposure in adaptive testing Y1 - 2007 A1 - Lewis, C. CY - D. J. Weiss (Ed.), Proceedings of the 2007 GMAC Conference on Computerized Adaptive Testing. N1 - {PDF file, 357 KB} ER - TY - JOUR T1 - A Bayesian method for the detection of item preknowledge in computerized adaptive testing JF - Applied Psychological Measurement Y1 - 2003 A1 - McLeod, L. A1 - Lewis, C. A1 - Thissen, D. KW - Adaptive Testing KW - Cheating KW - Computer Assisted Testing KW - Individual Differences computerized adaptive testing KW - Item KW - Item Analysis (Statistical) KW - Mathematical Modeling KW - Response Theory AB - With the increased use of continuous testing in computerized adaptive testing, new concerns about test security have evolved, such as how to ensure that items in an item pool are safeguarded from theft. In this article, procedures to detect test takers using item preknowledge are explored. When test takers use item preknowledge, their item responses deviate from the underlying item response theory (IRT) model, and estimated abilities may be inflated. This deviation may be detected through the use of person-fit indices. A Bayesian posterior log odds ratio index is proposed for detecting the use of item preknowledge. In this approach to person fit, the estimated probability that each test taker has preknowledge of items is updated after each item response. These probabilities are based on the IRT parameters, a model specifying the probability that each item has been memorized, and the test taker's item responses. Simulations based on an operational computerized adaptive test (CAT) pool are used to demonstrate the use of the odds ratio index. (PsycINFO Database Record (c) 2005 APA ) VL - 27 ER - TY - ABST T1 - Adaptive testing without IRT in the presence of multidimensionality (Research Report 02-09) Y1 - 2002 A1 - Yan, D. A1 - Lewis, C. A1 - Stocking, M. CY - Princeton NJ: Educational Testing Service ER - TY - CONF T1 - A comparison of computer mastery models when pool characteristics vary T2 - Paper presented at the annual meeting of the National Council on Measurement in Education Y1 - 2002 A1 - Smith, R. L. A1 - Lewis, C. JF - Paper presented at the annual meeting of the National Council on Measurement in Education CY - New Orleans LA N1 - {PDF file, 692 KB} ER - TY - CHAP T1 - Methods of controlling the exposure of items in CAT Y1 - 2000 A1 - Stocking, M. L. A1 - Lewis, C. CY - W. J. van der Linden and C. A. W. Glas (eds.), Computerized adaptive testing: Theory and practice (pp. 163-182). Norwell MA: Kluwer. ER - TY - JOUR T1 - Detecting item memorization in the CAT environment JF - Applied Psychological Measurement Y1 - 1999 A1 - McLeod L. D., A1 - Lewis, C. VL - 23 ER - TY - CONF T1 - Adaptive testing without IRT T2 - Paper presented at the annual meeting of the National Council on Measurement in Education Y1 - 1998 A1 - Yan, D. A1 - Lewis, C. A1 - Stocking, M. JF - Paper presented at the annual meeting of the National Council on Measurement in Education CY - San Diego CA N1 - (ERIC No. ED422359) ER - TY - CONF T1 - A Bayesian approach to detection of item preknowledge in a CAT T2 - Paper presented at the annual meeting of the National Council on Measurement in Education Y1 - 1998 A1 - McLeod, L. D. A1 - Lewis, C. JF - Paper presented at the annual meeting of the National Council on Measurement in Education CY - San Diego CA ER - TY - RPRT T1 - Comparability of paper-and-pencil and computer adaptive test scores on the GRE General Test Y1 - 1998 A1 - Schaeffer, G. A. A1 - Bridgeman, B. A1 - Golub-Smith, M. L. A1 - Lewis, C. A1 - Potenza, M. T. A1 - Steffen, M. PB - Educational Testing Services CY - Princeton, N.J. SN - ETS Research Report 98-38 ER - TY - ABST T1 - Comparability of paper-and-pencil and computer adaptive test scores on the GRE General Test (GRE Board Professional Report No 95-08P; Educational Testing Service Research Report 98-38) Y1 - 1998 A1 - Schaeffer, G. A1 - Bridgeman, B. A1 - Golub-Smith, M. L. A1 - Lewis, C. A1 - Potenza, M. T. A1 - Steffen, M. CY - Princeton, NJ: Educational Testing Service ER - TY - JOUR T1 - Controlling item exposure conditional on ability in computerized adaptive testing JF - Journal of Educational & Behavioral Statistics Y1 - 1998 A1 - Stocking, M. L. A1 - Lewis, C. AB - The interest in the application of large-scale adaptive testing for secure tests has served to focus attention on issues that arise when theoretical advances are made operational. One such issue is that of ensuring item and pool security in the continuous testing environment made possible by the computerized admin-istration of a test, as opposed to the more periodic testing environment typically used for linear paper-and-pencil tests. This article presents a new method of controlling the exposure rate of items conditional on ability level in this continuous testing environment. The properties of such conditional control on the exposure rates of items, when used in conjunction with a particular adaptive testing algorithm, are explored through studies with simulated data. VL - 23 N1 - American Educational Research Assn, US ER - TY - CONF T1 - Expected losses for individuals in Computerized Mastery Testing T2 - Paper presented at the annual meeting of National Council on Measurement in Education Y1 - 1998 A1 - Smith, R. A1 - Lewis, C. JF - Paper presented at the annual meeting of National Council on Measurement in Education CY - San Diego ER - TY - CONF T1 - A new approach for the detection of item preknowledge in computerized adaptive testing T2 - Paper presented at the annual meeting of the Psychometric Society Y1 - 1998 A1 - McLeod, L. D. A1 - Lewis, C. JF - Paper presented at the annual meeting of the Psychometric Society CY - Urbana, IL ER - TY - CONF T1 - Incorporating decision consistency into Bayesian sequential testing T2 - Paper presented at the annual meeting of National Council on Measurement in Education Y1 - 1997 A1 - Smith, R. A1 - Lewis, C. JF - Paper presented at the annual meeting of National Council on Measurement in Education CY - Chicago ER - TY - CONF T1 - Person-fit indices and their role in the CAT environment T2 - Paper presented at the Annual meeting of the National Council on Measurement in Education Y1 - 1996 A1 - David, L. A. A1 - Lewis, C. JF - Paper presented at the Annual meeting of the National Council on Measurement in Education CY - New York NY ER - TY - CONF T1 - Person-fit indices and their role in the CAT environment T2 - Paper presented at the annual meeting of the National Council on Measurement in Education Y1 - 1996 A1 - McLeod, L. D. A1 - Lewis, C. JF - Paper presented at the annual meeting of the National Council on Measurement in Education CY - New York ER - TY - CONF T1 - A search procedure to determine sets of decision points when using testlet-based Bayesian sequential testing procedures T2 - Paper presented at the annual meeting of National Council on Measurement in Education Y1 - 1996 A1 - Smith, R. A1 - Lewis, C. JF - Paper presented at the annual meeting of National Council on Measurement in Education CY - New York ER - TY - CONF T1 - A Bayesian computerized mastery model with multiple cut scores T2 - Paper presented at the annual meeting of the National Council on Measurement in Education Y1 - 1995 A1 - Smith, R. L. A1 - Lewis, C. JF - Paper presented at the annual meeting of the National Council on Measurement in Education CY - San Francisco CA ER - TY - CONF T1 - A comparison of two IRT-based models for computerized mastery testing when item parameter estimates are uncertain T2 - Paper presented at the annual meeting of the American Educational Research Association Y1 - 1995 A1 - Way, W. D. A1 - Lewis, C. A1 - Smith, R. L. JF - Paper presented at the annual meeting of the American Educational Research Association CY - San Francisco ER - TY - JOUR T1 - Computer-adaptive testing: A new breed of assessment JF - Journal of the American Dietetic Association Y1 - 1995 A1 - Ruiz, B. A1 - Fitz, P. A. A1 - Lewis, C. A1 - Reidy, C. VL - 95 ER - TY - JOUR T1 - Computer-adaptive testing: A new breed of assessment JF - Journal of the American Dietetic Association Y1 - 1995 A1 - Ruiz, B. A1 - Fitz, P. A. A1 - Lewis, C. A1 - Reidy, C. VL - 95 ER - TY - ABST T1 - Controlling item exposure conditional on ability in computerized adaptive testing (Research Report 95-25) Y1 - 1995 A1 - Stocking, M. L. A1 - Lewis, C. CY - Princeton NJ: Educational Testing Service. N1 - #ST95-25; also see #ST98057 ER - TY - ABST T1 - A new method of controlling item exposure in computerized adaptive testing (Research Report 95-25) Y1 - 1995 A1 - Stocking, M. L. A1 - Lewis, C. CY - Princeton NJ: Educational Testing Service ER - TY - ABST T1 - Computerized mastery testing using fuzzy set decision theory (Research Report 94-37) Y1 - 1994 A1 - Du, Y. A1 - Lewis, C. A1 - Pashley, P. J. CY - Princeton NJ: Educational Testing Service ER - TY - JOUR T1 - Computerized mastery testing using fuzzy set decision theory JF - Applied Measurement in Education Y1 - 1993 A1 - Du, Y. A1 - Lewis, C. A1 - Pashley, P. J. VL - 6 N1 - (Also Educational Testing Service Research Report 94-37) ER - TY - JOUR T1 - A comparison of the performance of simulated hierarchical and linear testlets JF - Journal of Educational Measurement Y1 - 1992 A1 - Wainer, H., A1 - Kaplan, B. A1 - Lewis, C. VL - 29 ER - TY - JOUR T1 - Computerized mastery testing with nonequivalent testlets JF - Applied Psychological Measurement Y1 - 1992 A1 - Sheehan, K., A1 - Lewis, C. VL - 16 ER - TY - JOUR T1 - Computerized Mastery Testing With Nonequivalent Testlets JF - Applied Psychological Measurement Y1 - 1992 A1 - Sheehan, K. A1 - Lewis, C. VL - 16 IS - 1 ER - TY - JOUR T1 - Building algebra testlets: A comparison of hierarchical and linear structures JF - Journal of Educational Measurement Y1 - 1991 A1 - Wainer, H., A1 - Lewis, C. A1 - Kaplan, B. A1 - Braswell, J. VL - 8 ER - TY - ABST T1 - Some empirical guidelines for building testlets (Technical Report 91-56) Y1 - 1991 A1 - Wainer, H., A1 - Kaplan, B. A1 - Lewis, C. CY - Princeton NJ: Educational Testing Service, Program Statistics Research ER - TY - ABST T1 - An adaptive algebra test: A testlet-based, hierarchically structured test with validity-based scoring Y1 - 1990 A1 - Wainer, H., A1 - Lewis, C. A1 - Kaplan, B, A1 - Braswell, J. CY - ETS Technical Report 90-92 N1 - Princeton NJ: Educational testing Service. ER - TY - JOUR T1 - Toward a psychometrics for testlets JF - Journal of Educational Measurement Y1 - 1990 A1 - Wainer, H., A1 - Lewis, C. VL - 27 ER - TY - JOUR T1 - Using Bayesian Decision Theory to Design a Computerized Mastery Test JF - Applied Psychological Measurement Y1 - 1990 A1 - Lewis, C. A1 - Sheehan, K. VL - 14 IS - 4 ER - TY - JOUR T1 - Computerized mastery testing JF - Machine-Mediated Learning Y1 - 1988 A1 - Lewis, C. A1 - Sheehan, K. VL - 2 ER -