Effects of the use of a conversational artificial intelligence chatbot on medical students’ patient-centered communication skill development in a metaverse environment

Abstract

This study investigated how the use of a conversational artificial intelligence (AI) chatbot improved medical students' patient-centered communication (PCC) skills and how it affected their motivation to learn using innovative interactive tools such as AI chatbots throughout their careers. This study adopted a onegroup post-test-only design to investigate the impact of AI chatbot-based learning on medical students' PCC skills, their learning motivation with AI chatbots, and their perception towards the use of AI chatbots in their learning. After a series of classroom activities, including metaverse exploration, AI chatbot-based learning activities, and classroom discussions, 43 medical students completed three surveys that measured their motivation to learn using AI tools for medical education, their perception towards the use of AI chatbots in their learning, and their self-assessment of their PCC skills. Our findings revealed significant correlations among learning motivation, PCC scores, and perception variables. Notably, the perception towards AI chatbot-based learning and AI chatbot learning motivation showed a very strong positive correlation (r=0.72), indicating that motivated students were more likely to perceive chatbots as beneficial educational tools. Additionally, a moderate correlation between motivation and self-assessed PCC skills (r=0.54) indicated that students motivated to use AI chatbots tended to rate their PCC skills more favorably. Similarly, a positive relationship (r=0.68) between students' perceptions of chatbot usage and their self-assessed PCC skills indicated that enhancing students' perceptions of AI tools could lead to better educational outcomes.