An Analysis of ChatGPT4 to Respond to Glaucoma-Related Questions

Abstract

Precis: In recent years, ChatGPT has been widely used as a source of information. In our study, it was revealed that ChatGPT gives accurate information about glaucoma. Purpose: We examined the knowledge of ChatGPT about glaucoma. Patients and Methods: Frequently asked questions about glaucoma found on websites of ophthalmology associations and hospitals, and social media applications were assessed. Evidence-Based Recommendations in the European Glaucoma Society Terminology and Guidelines for Glaucoma 5th Edition were evaluated. Using the ChatGPT - 4, each question was asked twice on different computers to assess the reproducibility of answers. The answers provided were recorded and two specialist ophthalmologists evaluated them independently, assigning scores ranging from 1 to 4. Results: The answers to all questions about glaucoma resulted in 88.7% completely correct, 7.5% correct but insufficient, and 3.8% misleading information and correct information. No question was answered completely incorrectly. While 85.8% of the general knowledge questions were answered correctly, 91.7%, 86.6%, and 91.7% of questions about diagnosis, treatment, and prevention were answered correctly, respectively. The number of questions prepared based on the European Glaucoma Society Terminology and Guidelines for Glaucoma was 16. The rate of completely correct answers to these questions was 75.0% (12). While 3 (18.8%) answers were correct but insufficient, 1 response (6.3%) contained false information and correct information. Conclusion: Our study revealed that ChatGPT answered nine out of ten questions about general information, diagnosis, treatment, and preventive and follow-up about glaucoma with acceptable and satisfactory accuracy rates. In addition, three of four answers given by ChatGPT were completely correct according to Terminology and Guidelines for Glaucoma.