The rapid expansion of psoriasis research literature presents challenges for efficient analysis and trend identification, necessitating advanced approaches. We propose AgenTopic, an interactive topic modeling framework that integrates BERT embeddings, dimensionality reduction, clustering, and a language model feedback loop to analyze psoriasis research literature from 2000 to 2023. Applied to PubMed articles, AgenTopic extracted 158 psoriasis-related topics across 8 categories, outperforming traditional methods in handling complex medical literature. Further trend analysis using multiple modeling techniques, including an SVR-Linear model, revealed non-linear patterns in research growth across categories (R2 values 0.75-0.97). Key trends identified include focus on nail psoriasis and spondyloarthritis, shift from TNF-α to IL-17 in pathogenesis understanding, rapid development of biologics and small molecule inhibitors, and increased attention to comorbidities. We developed an interactive web tool to facilitate literature retrieval and trend identification. To our knowledge, this application of an agent-based interactive topic modeling framework to dermatological literature is previously unreported. Using only topic-modeled data, our framework achieved comparable performance to expert manual review in identifying research trends. AgenTopic performed better than several state-of-the-art topic modeling methods and demonstrated the potential of AI in advancing medical literature analysis.
Read full abstract