Abstract
This study presents a hybrid keyword extraction method called SkyWords. It implements a novel supervised step based on the skyline operator and the majority voting principle for high-quality candidate keyword selection and an unsupervised step based on contextual semantics for the candidate keyword ranking. To achieve this, firstly, we build a feature vector database using the features of known keywords and then apply the skyline operator to retrieve the dominating feature vectors. To select the candidate keywords of a document, we compare each word of the document against the dominating feature vectors and assume the words that are as good as the majority of the dominating feature vectors as candidate keywords. To obtain the final set of keywords, we rank the candidate keywords based on their semantic similarity to the document based on their vector representation using the MPNet sentence transformer. We conducted experiments on six benchmark scholarly datasets to evaluate the performance of SkyWords and compared the results against eleven baseline keyword extraction systems. The experimental results show that the proposed novel keyword selection algorithm reduced the number of candidate keywords by several folds. Moreover, SkyWords achieved statistically significant improvements over the baseline methods in precision, recall, and F1 score. Compared to the baseline regarding ranking-based metrics, SkyWords achieved the highest mean average precision score for all datasets and the highest mean reciprocal rank score for all datasets but one. Furthermore, SkyWords extracted more relevant keywords than the baseline methods.
Talk to us
Join us for a 30 min session where you can share your feedback and ask us any queries you have
More From: Engineering Applications of Artificial Intelligence
Disclaimer: All third-party content on this website/platform is and will remain the property of their respective owners and is provided on "as is" basis without any warranties, express or implied. Use of third-party content does not indicate any affiliation, sponsorship with or endorsement by them. Any references to third-party content is to identify the corresponding services and shall be considered fair use under The CopyrightLaw.