Abstract
A large-scale language model is expected to have been trained with a large volume of data including cancer treatment protocols. The current study aimed to investigate the use of generative pretrained transformer 4 (GPT-4) for identifying the TNM classification of pancreatic cancers from existing radiology reports written in Japanese. We screened 100 consecutive radiology reports on computed tomography scan for pancreatic cancer from April 2020 to June 2022. GPT-4 was requested to classify the TNM from the radiology reports based on the General Rules for the Study of Pancreatic Cancer 7th Edition. The accuracy and kappa coefficient of the TNM classifications by GPT-4 was evaluated with the classifications by two experienced abdominal radiologists as gold standard. The accuracy values of the T, N, and M factors were 0.73, 0.91, and 0.93, respectively. The kappa coefficients were 0.45 for T, 0.79 for N, and 0.83 for M. Although GPT is familiar with the TNM classification for pancreatic cancer, its performance in classifying actual cases in this experiment may not be adequate.
Talk to us
Join us for a 30 min session where you can share your feedback and ask us any queries you have
Similar Papers
Disclaimer: All third-party content on this website/platform is and will remain the property of their respective owners and is provided on "as is" basis without any warranties, express or implied. Use of third-party content does not indicate any affiliation, sponsorship with or endorsement by them. Any references to third-party content is to identify the corresponding services and shall be considered fair use under The CopyrightLaw.