IntroductionSince November 2022, when Chat generative pre-trained transformer (ChatGPT) was released, studies have been conducted to explore its potential use in various text-based areas. In the field of Korean Medicine (KM), studies evaluating the feasibility of ChatGPT are mainly focused on the educational domain. This study aimed to 1) identify the current level of ChatGPT-generated responses in answering questions from patients and KM practitioners, specifically exemplified by facial palsy and 2) explore the potential applicability of ChatGPT in KM practice through a perception survey of experts. MethodsThis study evaluates the applicability of ChatGPT concerning facial palsy through a survey of board-certified acupuncturists. The survey comprises two parts: assessing response quality for patients and for KM doctors in clinical practice. Ethical approval was obtained, and a 36-item questionnaire was administered online to 33 participants. Responses were analyzed for quality, relevance, and applicability using a combination of Likert scales and a standardized assessment tool. ResultsAmong 33 eligible participants, 30 board-certified acupuncturists agreed to participate (response rate: 90.9%). Survey results showed that the applicability of ChatGPT was lower for specialized KM practitioner inquiries than for general patient inquiries. Although the responses were considered useful to the readers (part 1: 96.7%, part 2: 63.3%) and understandable (part 1: 66.7%, part 2: 60%), the proportion of positive evaluations was relatively low in the domains assessing reliability and sufficiency. ConclusionsThough ChatGPT is generally viewed positively for its potential utility, its direct application in KM clinical practice treating facial palsy at its current level seems challenging. To improve reliability, the information generated by ChatGPT should be critically reviewed by qualified expert medical personnel. To enhance sufficiency, further training of the artificial intelligence model with additional KM information is required.
Read full abstract