A research method using microcomputers to assess conceptual understanding and problem solving

Abstract

Important goals in science education include the elucidation of how students develop a world view, reason about new information, and solve problems. This paper focuses on a research strategy using microcomputers that is directed towards elucidating conceptual understanding and problem solving strategies used by subjects interacting with an open-ended genetics simulation. The field method employed in this study is termed “structured observations”. The use of this method facilitated the generation of data during problem solving sessions by subjects in a think aloud protocol. Three sets of synchronized information of subjects’ interactions with the software were obtained: a video image which provided the sequence and duration of computer screen displays, a video image of subjects, and an audio track of verbal commentaries. The verbal protocol data, complemented by synchronized visual data, were analyzed using software tools for qualitative analysis. The use of these kinds of software programs aided researchers in the analysis of complex, qualitative data. The data were subjected to codings as text files, searches for patterns, and retrievals of patterns among coded variables. Frequency tables of the codes and patterns were generated for further interpretation. By these means, patterns of operations can be identified and inferences made about problem solvers’ conceptual understanding.