Computer-based Assessment of Problem Solving Competence

Abstract

Problem solving competence cannot be described as a unidimensional construct. At least analytical and dynamic aspects of problem solving competence have to be distinguished if all aspects of problem solving are to be covered. Analytical problem solving abilities are needed to structure, represent and integrate information. Dynamic problem solving includes aspects of self-regulated learning as well as the ability to adapt the problem solving process to a changing environment by continuously processing feedback information. The assessment of dynamic aspects of problem solving competence requires dynamic test environments. As a German national option of PISA 2000, the analytical and dynamic problem solving competencies of 15-year-old students were tested using paper-and-pencil tests as well as computer-based assessments. Results show that analytical aspects of problem solving competence are strongly correlated with reasoning, while dynamic problem solving reflects a specific dimension of self-regulated exploration and control that can be identified across computer-simulated domains.