Feasibility of Machine Scoring of Concept Maps

Abstract

This report documents progress at the Center for Research on Evaluation, Standards, and Student Testing (CRESST) on the feasibility of scoring concept maps using technology. CRESST, in its integrated simulation approach to assessment, has assembled a suite of performance assessment tasks (the integrated simulation) onto which they have mapped the types of learning -expected of students. One element of the integrated simulation is an online concept mapping construction and scoring system. A concept map is a graphical representation of information consisting of nodes and labeled lines. The nodes correspond to concepts in a subject area or domain, and lines indicate a relationship between pairs of concepts. Concept mapping software has been developed to permit students to construct concept mapd and to provide real-time scoring and feedback to students based on an expert's map. An expert criterion map is used to score students' concept maps. CRESST has also studied the viability of using collaborative concept mapping in a networked computer environment as an assessment tool. Ongoing research suggests that both types of concept map use are promising. A feasible solution for schools without extensive computer resources is suggested through computerized scoring of paper-and-pencil administered concept maps. Several technologies for this purpose that CRESST has explored are described. (Contains 2 tables, 3 figures, and 12 references.) (SLD) ******************************************************************************** Reproductions supplied by EDRS are the best that can be made from the original document. ******************************************************************************** 00 11 00 41 Zr A 44 . . . . . I Feasibility of Machine Scoring of Concept Maps CSE Technical Report 460 Harold F. O'Neil, Jr. University of Southern California/CRESST Davina C. D. Klein CRESST/University of California, Los Angeles PERMISSION TO REPRODUCE AND DISSEMINATE THIS MATERIAL HAS BEEN GRANTED BY TO THE EDUCATIONAL RESOURCES INFORMATION CENTER (ERIC) U S DEPARTMENT OF EDUCATION Office Educational Research and Improvement EDU ATIONAL RESOURCES INFORMATION CENTER (ERIC) This document has been reproduced as received from the person or organization originating it Minor changes have been made to improve reproduction quality Points of view or opinions stated in this document do not necessarily represent official OERI position or policy BEST COPY AVAILABLE 4 UCLA Center for the Study of Evaluation in collaboration with: University of Colorado NORC, University of Chicago LRDC, University of Pittsburgh lo University of California, Santa Barbara University of Southern California The RAND Corporation Feasibility of Machine Scoring of Concept Maps CSE Technical Report 460 Harold F. O'Neil, Jr. University of Southern California/CRESST Davina C. D. Klein CRESST/University of California, Los Angeles