Automatic Assessment of Problem-Solving Skills in Mathematics

Abstract

Since 1985 the CALM Project for computer aided learning in mathematics at Heriot-Watt University in Edinburgh has delivered automatic assessment to large groups of students in engineering and science. Initially, CALM used the computer to assess basic mathematical skills/techniques and acquired facts/knowledge. CALM has been proud of its testing capability, providing as it does a comparison of numerical and mathematical expressions as answers. This is well beyond the multiple-choice format favoured in some subjects but not appropriate in much of mathematics. However, much progress has been made through the design of intermediate steps, the inclusion of hints and the extension of question types. In the SCHOLAR Project, delivered over the Web to 58,000 students in all Scottish schools during the last academic year, more complex mathematical skills have been tested automatically using the on-line assessment engine known as CUE. This article addresses the advances in automatic assessment with particular emphasis on mathematics. The capability of the computer to assess more general problem-solving skills in mathematics is explored. The article concludes with some thoughts on how the subject might expand in the near future.