PROF 2.0: Improving a Methodology for Topic Map and Skill Tree Creation

Abstract

This paper explores the Pedagogical Resource Organization Framework (PROF), which takes content from a current course, creates a Topic Map (TM), then transforms this TM into a Knowledge, Skills, and Abilities Tree (KSAT) by ingesting a schedule document to give direction. Transitioning from unorganized TMs to structured KSATs is the fundamental methodology educators follow to develop clear learning paths and education assessments for students [1]; this is a time consuming process. We initially evaluated PROF against a graduate level course and compared the resulting Topic Map to a manually created Topic Map for the same course to measure its effectiveness [2]. The results showed that in under one working hour PROF produced a TM containing over 36%exact matches and over 93% adjusted matches to the SME-Created TM. In this updated version of PROF, we re-evaluate this course as well as the Network Warfare Bridge Course (NWBC) hosted by the 39th Information Operations Squadron. Using a more exact whitelisting process to find specific lesson objectives, PROF increased the identification of topics for the initial course and identified over 51% of topics for the NWBC. PROF also produced a TM for each, with a more accurate TM for the initial course, as well as KSATs for both courses using nodes from the TM for educators to align learning objectives with course readings.