Semantic competence and prototypical verbalizations are associated with higher OSCE and global medical degree scores: a multi-theory pilot study on year 6 medical student verbalizations.

Abstract

The organization of medical knowledge is reflected in language and can be studied from the viewpoints of semantics and prototype theory. The purpose of this study is to analyze student verbalizations during an Objective Structured Clinical Examination (OSCE) and correlate themwith test scores and final medical degree (MD) scores. Wehypothesize that students whose verbalizations are semantically richer and closer to the disease prototype will show better academic performance. We conducted a single-center study during a year 6 (Y6) high-stakes OSCE where one probing intervention wasincluded at the end of the exam to capture students' reasoning about one of the clinical cases. Verbalizations were transcribed and coded. An assessment panel categorized verbalizations regarding their semantic value (Weak, Good, Strong). Semantic categories and prototypical elements were compared with OSCE, case-based exam and global MD scores. Students with Semantic 'Strong' verbalizations displayed higher OSCE, case-based exam and MD scores, while the use of prototypical elements was associated with higher OSCE and MD scores. Semantic competence and verbalizations matching the disease prototype may identify students withbetter organization of medical knowledge. This work provides empirical groundwork for future research on language analysis to support assessment decisions.