03049nas a2200241 4500008004100000020004100041245017000082210007100252250001500323300001000338490000700348520214300355653001402498653006602512653001102578653001302589100001402602700001202616700001402628700001502642700001702657856013302674 2010 spa d a0214-9915 (Print)0214-9915 (Linking)00aDeterioro de parámetros de los ítems en tests adaptativos informatizados: estudio con eCAT [Item parameter drift in computerized adaptive testing: Study with eCAT]0 aDeterioro de parámetros de los ítems en tests adaptativos inform a2010/04/29 a340-70 v223 a
En el presente trabajo se muestra el análisis realizado sobre un Test Adaptativo Informatizado (TAI) diseñado para la evaluación del nivel de inglés, denominado eCAT, con el objetivo de estudiar el deterioro de parámetros (parameter drift) producido desde la calibración inicial del banco de ítems. Se ha comparado la calibración original desarrollada para la puesta en servicio del TAI (N= 3224) y la calibración actual obtenida con las aplicaciones reales del TAI (N= 7254). Se ha analizado el Funcionamiento Diferencial de los Ítems (FDI) en función de los parámetros utilizados y se ha simulado el impacto que sobre el nivel de rasgo estimado tiene la variación en los parámetros. Los resultados muestran que se produce especialmente un deterioro de los parámetros a y c, que hay unimportante número de ítems del banco para los que existe FDI y que la variación de los parámetros produce un impacto moderado en la estimación de θ de los evaluados con nivel de inglés alto. Se concluye que los parámetros de los ítems se han deteriorado y deben ser actualizados.Item parameter drift in computerized adaptive testing: Study with eCAT. This study describes the parameter drift analysis conducted on eCAT (a Computerized Adaptive Test to assess the written English level of Spanish speakers). The original calibration of the item bank (N = 3224) was compared to a new calibration obtained from the data provided by most eCAT operative administrations (N =7254). A Differential Item Functioning (DIF) study was conducted between the original and the new calibrations. The impact that the new parameters have on the trait level estimates was obtained by simulation. Results show that parameter drift is found especially for a and c parameters, an important number of bank items show DIF, and the parameter change has a moderate impact on high-level-English θ estimates. It is then recommended to replace the original estimates by the new set. by the new set.
10a*Software10aEducational Measurement/*methods/*statistics & numerical data10aHumans10aLanguage1 aAbad, F J1 aOlea, J1 aAguado, D1 aPonsoda, V1 aBarrada, J R uhttp://www.iacat.org/content/deterioro-de-par%C3%A1metros-de-los-%C3%ADtems-en-tests-adaptativos-informatizados-estudio-con-ecat00516nas a2200145 4500008004100000245008100041210006900122300000900191490000600200100001700206700001200223700001500235700001400250856010600264 2009 eng d00aItem selection rules in computerized adaptive testing: Accuracy and security0 aItem selection rules in computerized adaptive testing Accuracy a a7-170 v51 aBarrada, J R1 aOlea, J1 aPonsoda, V1 aAbad, F J uhttp://www.iacat.org/content/item-selection-rules-computerized-adaptive-testing-accuracy-and-security00587nas a2200133 4500008004100000245008400041210006900125260009700194100001700291700001200308700001500320700001400335856010400349 2009 eng d00aTest overlap rate and item exposure rate as indicators of test security in CATs0 aTest overlap rate and item exposure rate as indicators of test s aD. J. Weiss (Ed.), Proceedings of the 2009 GMAC Conference on Computerized Adaptive Testing.1 aBarrada, J R1 aOlea, J1 aPonsoda, V1 aAbad, F J uhttp://www.iacat.org/content/test-overlap-rate-and-item-exposure-rate-indicators-test-security-cats00546nas a2200145 4500008004100000245009900041210006900140300001200209490000700221100001700228700001200245700001500257700001400272856011400286 2008 eng d00aIncorporating randomness in the Fisher information for improving item-exposure control in CATs0 aIncorporating randomness in the Fisher information for improving a493-5130 v611 aBarrada, J R1 aOlea, J1 aPonsoda, V1 aAbad, F J uhttp://www.iacat.org/content/incorporating-randomness-fisher-information-improving-item-exposure-control-cats02212nas a2200229 4500008004100000020004600041245008500087210006900172260004500241300001000286490000600296520140300302653003401705653002301739653002601762653001701788653002601805100001701831700001201848700001501860856010701875 2007 eng d a1614-1881 (Print); 1614-2241 (Electronic)00aMethods for restricting maximum exposure rate in computerized adaptative testing0 aMethods for restricting maximum exposure rate in computerized ad bHogrefe & Huber Publishers GmbH: Germany a14-230 v33 aThe Sympson-Hetter (1985) method provides a means of controlling maximum exposure rate of items in Computerized Adaptive Testing. Through a series of simulations, control parameters are set that mark the probability of administration of an item on being selected. This method presents two main problems: it requires a long computation time for calculating the parameters and the maximum exposure rate is slightly above the fixed limit. Van der Linden (2003) presented two alternatives which appear to solve both of the problems. The impact of these methods in the measurement accuracy has not been tested yet. We show how these methods over-restrict the exposure of some highly discriminating items and, thus, the accuracy is decreased. It also shown that, when the desired maximum exposure rate is near the minimum possible value, these methods offer an empirical maximum exposure rate clearly above the goal. A new method, based on the initial estimation of the probability of administration and the probability of selection of the items with the restricted method (Revuelta & Ponsoda, 1998), is presented in this paper. It can be used with the Sympson-Hetter method and with the two van der Linden's methods. This option, when used with Sympson-Hetter, speeds the convergence of the control parameters without decreasing the accuracy. (PsycINFO Database Record (c) 2007 APA, all rights reserved)10acomputerized adaptive testing10aitem bank security10aitem exposure control10aoverlap rate10aSympson-Hetter method1 aBarrada, J R1 aOlea, J1 aPonsoda, V uhttp://www.iacat.org/content/methods-restricting-maximum-exposure-rate-computerized-adaptative-testing01668nas a2200229 4500008004100000245005500041210005300096300000800149490000700157520102900164653002101193653001201214653003001226653001801256653000901274100001701283700001201300700001501312700001601327700001401343856008101357 2004 eng d00aAssisted self-adapted testing: A comparative study0 aAssisted selfadapted testing A comparative study a2-90 v203 aA new type of self-adapted test (S-AT), called Assisted Self-Adapted Test (AS-AT), is presented. It differs from an ordinary S-AT in that prior to selecting the difficulty category, the computer advises examinees on their best difficulty category choice, based on their previous performance. Three tests (computerized adaptive test, AS-AT, and S-AT) were compared regarding both their psychometric (precision and efficiency) and psychological (anxiety) characteristics. Tests were applied in an actual assessment situation, in which test scores determined 20% of term grades. A sample of 173 high school students participated. Neither differences in posttest anxiety nor ability were obtained. Concerning precision, AS-AT was as precise as CAT, and both revealed more precision than S-AT. It was concluded that AS-AT acted as a CAT concerning precision. Some hints, but not conclusive support, of the psychological similarity between AS-AT and S-AT was also found. (PsycINFO Database Record (c) 2005 APA ) (journal abstract)10aAdaptive Testing10aAnxiety10aComputer Assisted Testing10aPsychometrics10aTest1 aHontangas, P1 aOlea, J1 aPonsoda, V1 aRevuelta, J1 aWise, S L uhttp://www.iacat.org/content/assisted-self-adapted-testing-comparative-study00405nas a2200109 4500008004100000245003400041210003400075260009400109100001500203700001200218856006500230 2003 eng d00aComputerized adaptive testing0 aComputerized adaptive testing aR. Fernández-Ballesteros (Ed.): Encyclopaedia of Psychological Assessment. London: Sage.1 aPonsoda, V1 aOlea, J uhttp://www.iacat.org/content/computerized-adaptive-testing-000437nas a2200109 4500008004100000245006900041210006700110260002700177100001200204700001500216856009600231 2003 eng d00aTests adaptativos informatizados (Computerized adaptive testing)0 aTests adaptativos informatizados Computerized adaptive testing aMadrid: UNED Ediciones1 aOlea, J1 aPonsoda, V uhttp://www.iacat.org/content/tests-adaptativos-informatizados-computerized-adaptive-testing00372nas a2200133 4500008004100000245003800041210003600079300001200115490000700127100001400134700001500148700001200163856006300175 2002 eng d00aSelf-adapted testing: An overview0 aSelfadapted testing An overview a107-1220 v121 aWise, S L1 aPonsoda, V1 aOlea, J uhttp://www.iacat.org/content/self-adapted-testing-overview00450nas a2200145 4500008004100000245005800041210005400099300000900153490000700162100001700169700001500186700001200201700001400213856007700227 2000 eng d00aThe choice of item difficulty in self adapted testing0 achoice of item difficulty in self adapted testing a3-120 v161 aHontangas, P1 aPonsoda, V1 aOlea, J1 aWise, S L uhttp://www.iacat.org/content/choice-item-difficulty-self-adapted-testing00692nas a2200169 4500008004100000020001400041245015800055210006900213300001200282490000600294653003400300100001700334700001500351700001200366700001400378856013000392 2000 eng d a1575-910500aLos tests adaptativos informatizados en la frontera del siglo XXI: Una revisión [Computerized adaptive tests at the turn of the 21st century: A review]0 aLos tests adaptativos informatizados en la frontera del siglo XX a183-2160 v210acomputerized adaptive testing1 aHontangas, P1 aPonsoda, V1 aOlea, J1 aAbad, F J uhttp://www.iacat.org/content/los-tests-adaptativos-informatizados-en-la-frontera-del-siglo-xxi-una-revisi%C3%B3n-computerized00867nas a2200145 4500008004100000245006600041210006600107300001200173490000700185520036100192653002100553653004400574100001500618856008800633 2000 eng d00aOverview of the computerized adaptive testing special section0 aOverview of the computerized adaptive testing special section a115-1200 v213 aThis paper provides an overview of the five papers included in the Psicologica special section on computerized adaptive testing. A short introduction to this topic is presented as well. The main results, the links between the five papers and the general research topic to which they are more related are also shown. (PsycINFO Database Record (c) 2005 APA )10aAdaptive Testing10aComputers computerized adaptive testing1 aPonsoda, V uhttp://www.iacat.org/content/overview-computerized-adaptive-testing-special-section00569nas a2200145 4500008004100000245010600041210006900147300001200216490000700228100001500235700001200250700001900262700001600281856012600297 1999 eng d00aThe effects of test difficulty manipulation in computerized adaptive testing and self-adapted testing0 aeffects of test difficulty manipulation in computerized adaptive a167-1840 v121 aPonsoda, V1 aOlea, J1 aRodriguez, M S1 aRevuelta, J uhttp://www.iacat.org/content/effects-test-difficulty-manipulation-computerized-adaptive-testing-and-self-adapted-testin-200522nas a2200121 4500008004100000245010600041210006900147260002100216100001200237700001500249700001700264856011900281 1999 eng d00aTests informatizados: Fundamentos y aplicaciones (Computerized testing: Fundamentals and applications0 aTests informatizados Fundamentos y aplicaciones Computerized tes aMadrid: Pirmide.1 aOlea, J1 aPonsoda, V1 aPrieto, Eds. uhttp://www.iacat.org/content/tests-informatizados-fundamentos-y-aplicaciones-computerized-testing-fundamentals-and00466nas a2200121 4500008004100000245008300041210006900124300001200193490000700205100001300212700001500225856010400240 1998 eng d00aA comparison of item exposure control methods in computerized adaptive testing0 acomparison of item exposure control methods in computerized adap a311-3270 v351 aRevuelta1 aPonsoda, V uhttp://www.iacat.org/content/comparison-item-exposure-control-methods-computerized-adaptive-testing00512nas a2200145 4500008004100000245008100041210006900122300001200191490000700203100001500210700001400225700001200239700001600251856009900267 1997 eng d00aAn investigation of self-adapted testing in a Spanish high school population0 ainvestigation of selfadapted testing in a Spanish high school po a210-2210 v571 aPonsoda, V1 aWise, S L1 aOlea, J1 aRevuelta, J uhttp://www.iacat.org/content/investigation-self-adapted-testing-spanish-high-school-population00542nas a2200121 4500008004500000245012600045210007100171300000800242490000600250100001600256700001500272856013300287 1997 Spandsh 00aUna solución a la estimatión inicial en los tests adaptivos informatizados [A solution to initial estimation in CATs.] 0 aUna solución a la estimatión inicial en los tests adaptivos info a1-60 v21 aRevuelta, J1 aPonsoda, V uhttp://www.iacat.org/content/una-soluci%C3%B3n-la-estimati%C3%B3n-inicial-en-los-tests-adaptivos-informatizados-solution-initial00553nas a2200121 4500008004500000245015200045210006900197300001200266490000700278100001600285700001500301856011500316 1996 Spandsh 00aMetodos sencillos para el control de las tasas de exposicion en tests adaptativos informatizados [Simple methods for item exposure control in CATs]0 aMetodos sencillos para el control de las tasas de exposicion en a161-1720 v171 aRevuelta, J1 aPonsoda, V uhttp://www.iacat.org/content/metodos-sencillos-para-el-control-de-las-tasas-de-exposicion-en-tests-adaptativos00637nas a2200145 4500008004500000245018700045210006900232300001000301490000700311100001300318700001500331700001600346700001400362856011500376 1996 Spandsh 00aPropiedades psicometricas du un test adaptivo informatizado do vocabulario ingles [Psychometric properties of a computerized adaptive tests for the measurement of English vocabulary]0 aPropiedades psicometricas du un test adaptivo informatizado do v a61-730 v551 aOlea., J1 aPonsoda, V1 aRevuelta, J1 aBelchi, J uhttp://www.iacat.org/content/propiedades-psicometricas-du-un-test-adaptivo-informatizado-do-vocabulario-ingles00437nas a2200109 4500008004100000245006800041210006600109260003000175100001200205700001500217856009500232 1996 eng d00aTest adaptativos informatizados [Computerized adaptive testing]0 aTest adaptativos informatizados Computerized adaptive testing aMadrid, UNEDbUniversitas1 aOlea, J1 aPonsoda, V uhttp://www.iacat.org/content/test-adaptativos-informatizados-computerized-adaptive-testing00589nas a2200121 4500008004500000245017100045210006900216260001800285100001200303700001500315700001400330856012300344 1995 Spandsh 00aTests adaptivos y autoadaptados informatizados: Effects en la ansiedad y en la pecision de las estimaciones [SATs and CATS: Effects on enxiety and estimate precision]0 aTests adaptivos y autoadaptados informatizados Effects en la ans aMurcia, Spain1 aOlea, J1 aPonsoda, V1 aWise, S L uhttp://www.iacat.org/content/tests-adaptivos-y-autoadaptados-informatizados-effects-en-la-ansiedad-y-en-la-pecision-de00484nas a2200133 4500008004100000245008100041210006900122300001200191490000700203100001500210700000900225700001600234856010000250 1994 eng d00aADTEST: A computer-adaptive tests based on the maximum information principle0 aADTEST A computeradaptive tests based on the maximum information a680-6860 v541 aPonsoda, V1 aOlea1 aRevuelta, J uhttp://www.iacat.org/content/adtest-computer-adaptive-tests-based-maximum-information-principle