Accumulating and visualising tacit knowledge of teachers on educational assessments

Abstract

Assessments, embedded with teachers' implicit (i.e. tacit) domain knowledge, play an important role in evaluating 'comprehension of a subject. The knowledge on the importance of both the concepts and their relationships of a subject, if captured, made explicit, and shared around, may greatly help teachers construct more effective assessments. This study establishes a methodology to accumulate tacit knowledge of specific topics from collected assessments by using an implicit knowledge extraction mechanism and, visualises the overall importance distribution of concepts by using knowledge maps for helping teachers compile their assessments. Several two stage experiments, scheduled for one semester, were conducted in the third grade natural science courses at elementary schools in Taiwan. Eighteen teachers who actually teach the courses participated in the experiments, and thirty students were in each course. In the first stage, teachers compiled assessments without using IKMAAS's knowledge map features while in the second stage, they did use them. System usage records, questionnaires and interview results were used for evaluating the usability of the methodology and the satisfaction of using IKMAAS. The results indicate the potential of the methodology, as each of the teachers agreed that the visualised assessment knowledge helped them to comprehend the proportions of concepts they intended to test easily and, additionally, helped them to clearly notice concepts they may have ignored. Yet the results in this study also show the potential of using knowledge maps and knowledge accumulating methodology in pedagogy paradigm.