A study of the effect of HyperCard and pen-paper performance assessment methods on expert-novice chemistry problem solving

Abstract

This study investigated HyperCard as a tool for assessment in science education and determined whether or not a HyperCard assessment instrument could differentiate between expert and novice student performance (balancing stoichiometric equations) in science education. Five chemical equations were presented by traditional pen-paper and by a HyperCard (Hyperequation) program. Thirty honors (expert) and 30 regular (novice) chemistry students were randomly divided into HyperCard and traditional pen-paper groups of 15 students each. Scoring was based on five dependent variables: performance scores, number of attempts, rate of attempts, time on task, and correctness. Correlation results indicated that students with high performance scores correctly balanced more equations, required fewer attempts to balance equations, and required less time per attempt than did students with low performance scores. MANOVA results showed that performance scores and correctness scores for both experts and novice were significantly higher on HyperCard compared to pen-paper assessment; the novice scores on HyperCard nearly equaled the expert pen-paper assessment scores. Significant interactions were found for time on task and for correctness. The results suggest that HyperCard can be a suitable tool for assessment in science education and that such an instrument can differentiate between expert and novice student performance.