This study aims to check the practicality of performance assessment using a test item in computer-based testing. Among speaking test items in standardized computer-based tests, this investigator focuses on the picture-based narrative task. It asks the test-taker to describe what has happened based on a story illustrated in a series of six pictures on a computer screen. A total of 51 pre-service and in-service teachers took part in a questionnaire survey asking about the practicality of this task. The results show that the majority of the respondents thought the task seemed to be impractical for a classroom-based performance assessment. Only 10% of the respondents answered that they would use the task as a performance assessment in the classroom. The analysis of qualitative comments reveals the reasons for the low level of practicality. The respondents pointed out that the task would require individual one-on-one proctoring and take several hours for one teacher to evaluate a classroom of students. On the basis
of these findings, it is suggested that classroom teachers construct a database system for test-item input, selection, and extraction in order to use the picture-based story telling test item in the classroom. |