TitleIncorporation Of Content Balancing Requirements In Stratification Designs For Computerized Adaptive Testing
Publication TypeJournal Article
Year of Publication2003
AuthorsLeung, C-K, Chang, H-H, Hau, K-T
JournalEducational and Psychological Measurement
Volume63
Number2
Pagination257-270
Abstract

In computerized adaptive testing, the multistage a-stratified design advocates a new philosophy on pool management and item selection in which, contradictory to common practice, less discriminating items are used first. The method is effective in reducing item-overlap rate and enhancing pool utilization. This stratification method has been extended in different ways to deal with the practical issues of content constraints and the positive correlation between item difficulty and discrimination. Nevertheless, these modified designs on their own do not automatically satisfy content requirements. In this study, three stratification designs were examined in conjunction with three well developed content balancing methods. The performance of each of these nine combinational methods was evaluated in terms of their item security, measurement efficiency, and pool utilization. Results showed substantial differences in item-overlap rate and pool utilization among different methods. An optimal combination of stratification design and content balancing method is recommended.

URLhttp://epm.sagepub.com/content/63/2/257.abstract
DOI10.1177/0013164403251326