Computer Adaptive Tests for Common Core
There is considerable discussion about the use of computer adaptive testing for the upcoming common core assessments. I have been a big fan of CAT. (in fact with our partners at ITS we have administered computer adaptive tests in k-12 schools for nearly a decade.)
However, I question, on a large scale, whether the states/schools will 1) be able to handle this (do they have the hardware and tech support expertise) and 2) will they get enough benefit from this to make it worth it?
Pat raises some good points; CAT certainly offers a lot of advantages--both technically and administratively. However, I am skeptical that states will be able to take advantage of CAT. I see two main "enemies".
1) Lack of hardware, software, expertise- As hard as it is for me to believe, I have heard repeatedly that there are many Hardware/software/expertise obstacles. Several states report that they do not have the necessary equipment in many locations and/or the necessary connectivity. And, many say that even where there is hardware/software, there is not enough expertise to get this set up and running....again, hard to believe, but I have heard this too many times to ignore.
2) Resistance to innovation-- To many educators in k12 environments, CAT and computer administered testing in general still seems "radical" (despite the fact that it has been successfully used since the 1980's). CAT scares many people that do not understand the benefits of moving from simple paper and pencil number right scoring to more advanced scoring models offered by CAT. Even citing the fact that tests can be more accurate, shorter and reduce turn around times does not seem to mitigate this fear in some.
This Work, SEG Measurement, is licensed under a Creative Commons Attribution-NonCommercial-NoDerivs 3.0 Unported license, although certain works referenced herein may be separately licensed.
Pat Ward commented ·
One of the unheralded advantages of CAT is the ease of use in managing the item pool. It is much easier to configure and maintain a large pool of items that it is to manage many individual forms. And because pretest items can be randomly inserted into the tests, there is always a ready supply of new items. There will be some initial pain understanding the pros and cons of CAT, but in the long run I think there will be many advantages.