相違度を利用したリスト解答型問題のスコアリング法

Abstract

This paper discusses on a scoring method of list response question of which response is a list of elements, and the elements are completely ordered. List response questions include questions such as sequencing and application-operation type. Few papers focus attention on efficient scoring method when the correct answers are combinationally redundant, or on scoring method considering seriousness of mistakes. This paper deals with these problems in the case that the dissimilarity criterion is used for scoring. To realize an efficient scoring when plural correct answers exist, a method to construct a scoring operation graph from the correct answers and the examinee's answer, and to reduce it to solve the minimal cost problem is proposed. A heuristic function to solve the minimal cost problem using A* algorithm is also presented. When considering the seriousness of mistakes, deciding the degrees of penalty is an important problem. Here, we consider estimating the degrees from human scores, and decided them using regression model. A cooking task is taken for an example to verify the validity of our method.