Evaluation of the Pedagogical Impact of "Traum'Cast" Podcast: A Pilot Study Based on Metacognition.

Abstract

With the evolution of educational tools, the French Military medical service has created a podcast program, Traum'Cast, about the principles of war medicine, accessible online for free. Our objective was to measure the learning effect of the Traum'Cast program's first episode. A non-randomized pilot trial between July and December 2021 included 80 health care providers: 40 in the video podcast group compared to 40 in a group reading a pdf file providing the same information. Using a 10 MCQs, we evaluated knowledge acquisition before, just after, and 2 weeks after the intervention. It was measured using metacognition tools based on confidence marking (number of correct answers, score weighted by certainty level, and realism). Knowledge acquisition was better in the podcast group than in the pdf file group immediately after the intervention (correct answers: 9.0 [9.0-10.0] vs 9.0 [7.8-9.0], P = 0.015; weighted score: 177.0 [159.0-198.0] vs 160.0 [129.5-176.5], P = 0.020). This difference was persistent 2 weeks after (weighted score: 127.5 [101.8-145.2] vs 105.5 [74.2-128.5], P = 0.023). This podcast is an innovative teaching tool which has proven to strengthen the knowledge of the principles of war medicine.