The evolution and future directions of altmetrics research in computer science: A scoping review and bibliometric analysis

  • Abstract
  • Literature Map
  • Similar Papers
Abstract
Translate article icon Translate Article Star icon
Take notes icon Take Notes

Objective. The primary objective of this study was to analyze research performance and identify potential future research related to altmetrics in the last decade. Methodology. The dataset employed in this study was derived from the Scopus database. The PRISMA flow diagram was utilized during the data collection phase. The results of the bibliometric analysis were used to describe research performance and extract future work and directions. The method known as scoping review and bibliometric analysis (ScoRBA) was used to achieve these goals. Results. The dataset under consideration encompassed a total of 478 titles, derived from a sample of 93 journals. The Scientometrics journal was the primary source of information disseminating various research results in the field of altmetrics, followed by the Journal of Informetrics. Wang X. was an active and consistent contributor to the field of altmetrics, publishing studies related to the subject between 2015 and 2024. The results of the co-occurrence analysis of author keywords yielded three cluster themes from the altmetrics research. A close examination of the extant literature revealed the emergence of three cluster themes related to altmetrics research: (1) measurement and social impact of research, (2) impact of research through traditional and alternative metrics, and (3) the role of artificial intelligence (AI) and social media in impact analysis and dissemination of research. It was evident that the subjects of social impact and machine learning were intricately intertwined, constituting a multifaceted and evolving research domain characterized by dynamic developments and ongoing advancements. Conclusion. The study concluded that the altmetrics field had reached a stage of maturity, with a shift in focus from exploratory expansion to more in-depth, high-impact studies. In light of these findings, future research should concentrate on expanding data sources, refining tracking methods, and developing more sophisticated AI-driven models that can integrate both traditional and alternative metrics to achieve a truly holistic understanding of research impact.

Similar Papers
  • Book Chapter
  • 10.1007/978-3-031-52607-7_23
Framework for Enhancing the Social Impact of Tourism Research
  • Jan 1, 2024
  • Alba Viana-Lora + 3 more

This study addresses the importance of enhancing the social impact of tourism research through the implementation of a theoretical framework. The article presents the results of a review of the existing literature on the social impact of research. Key aspects for the design of a framework to enhance social impact are identified, including the identification of relevant social problems, the involvement of relevant stakeholders, a multidisciplinary approach, appropriate ethics, effective communication and impact evaluation. A series of interconnected steps are proposed to enhance the social impact of tourism research. The proposed framework seeks to address the current deficiencies in the connection between tourism research and social impact, promoting a participatory and multidisciplinary approach that generates positive change in society. Enhancing the social impact of tourism research is fundamental to maximising its effectiveness and achieving positive change in local communities.

  • Research Article
  • Cite Count Icon 4
  • 10.7759/cureus.27111
The Author-Level Metrics Study: An Analysis of the Traditional and Alternative Metrics of Scholarly Impact for Neurosurgical Authors
  • Jul 21, 2022
  • Cureus
  • Sukumar Kalvapudi + 4 more

Background and objectiveThere is a paucity of information regarding the concordance of traditional metrics across publicly searchable databases and about the correlation between alternative and traditional metrics for neurosurgical authors. In this study, we aimed to assess the congruence between traditional metrics reported across Google Scholar (GS), Scopus (Sc), and ResearchGate (RG). We also aimed to establish the mathematical correlation between traditional metrics and alternative metrics provided by ResearchGate.MethodsAuthor names listed on papers published in the Journal of Neurosurgery (JNS) in 2019 were collated. Traditional metrics [number of publications (NP), number of citations (NC), and author H-indices (AHi)] and alternative metrics (RG score, Research Interest score, etc. from RG and the GS i10-index) were also collected from publicly searchable author profiles. The concordance between the traditional metrics across the three databases was assessed using the intraclass correlation coefficient and Bland-Altman (BA) plots. The mathematical relation between the traditional and alternative metrics was analyzed.ResultsThe AHi showed excellent agreement across the three databases studied. The level of agreement for NP and NC was good at lower median counts. At higher median counts, we found an increase in disagreement, especially for NP. The RG score, number of followers on RG, and Research Interest score independently predicted NC and AHi with a reasonable degree of accuracy.ConclusionsA composite author-level matrix with AHi, RG score, Research Interest score, and the number of RG followers could be used to generate an "Impact Matrix" to describe the scholarly and real-world impact of a clinician’s work.

  • Research Article
  • Cite Count Icon 1
  • 10.3390/tourhosp6010039
Relation Between Gender and Risk in Tourism: A Data-Driven Exploration of Destination Choice
  • Mar 2, 2025
  • Tourism and Hospitality
  • Maria Armiñana-Maristany + 2 more

This study explores how gender influences risk perception and tourist destination choice by examining the academic literature from the Web of Science and Scopus databases spanning 1995 to 2022. Through bibliometric methods, this research uncovers patterns, leading themes, and gaps in integrating gender within tourism and risk perception studies, especially during periods of heightened global risk awareness. Using bibliometric analysis, with keywords, citations, and author networks in relevant publications, co-authorship and co-citation analyses were used to identify key contributors and thematic clusters. Data visualization through VOSviewer and SCIMAT provided insights into relational trends, while alternative metrics offered a broader perspective on research dissemination and relevance. Results indicate that gender is gradually being incorporated into research on risk and tourist destination choice but remains less central than risk perception and tourism. Research in this area tends to increase in response to global crises, such as the COVID–19 pandemic. This study examines English language publications from Web of Science and Scopus, potentially limiting the generalizability of findings to non-Western contexts. By examining temporal trends, influential authors, and alternative metrics, this analysis reveals new pathways for integrating gender more fully into tourism and risk research.

  • Research Article
  • Cite Count Icon 8
  • 10.1080/08998280.2021.1963184
Alternative publication metrics in the time of COVID-19
  • Jul 31, 2021
  • Baylor University Medical Center Proceedings
  • Christopher J Peterson + 2 more

Alternative metrics are unique bibliometrics comprising social, news, and other sources of media outside of traditional academic citations. Some have suggested that these metrics can complement traditional metrics of research impact, including public engagement with research. The COVID-19 pandemic provides a unique opportunity to study alternative metrics and the dissemination of scientific research given the heightened academic and public interest. This study analyzed Altmetric Attention Scores for the top 25 publications on COVID-19 and the top 25 non–COVID-19 publications in 2020. There were significantly higher levels of social attention scores across multiple metrics for COVID-19 articles than for non–COVID-19 articles for that year. There was a slightly higher goodness of fit between Altmetric Attention Scores and academic citations for COVID-19 publications than for non–COVID-19 publications, although trendline differences were not significant. These results suggest that researchers should be aware that their studies can become highly visible on publicly available social and news media platforms, especially during events of high interest (such as a global pandemic).

  • Front Matter
  • Cite Count Icon 3
  • 10.1111/nicc.12925
From impact factors to Altmetrics: What numbers are important in publishing your paper?
  • Jun 1, 2023
  • Nursing in Critical Care
  • Natalie L Mcevoy + 1 more

From impact factors to Altmetrics: What numbers are important in publishing your paper?

  • Research Article
  • Cite Count Icon 14
  • 10.1016/j.jaap.2023.106190
Evaluating the evolution and impact of wood vinegar research: A bibliometric study
  • Sep 23, 2023
  • Journal of Analytical and Applied Pyrolysis
  • Ridha Mhamdi

Evaluating the evolution and impact of wood vinegar research: A bibliometric study

  • PDF Download Icon
  • Research Article
  • Cite Count Icon 20
  • 10.1007/s11192-018-2727-5
#Psychology: a bibliometric analysis of psychological literature in the online media
  • Mar 31, 2018
  • Scientometrics
  • Sebastian Vogl + 2 more

Online media and especially social media are becoming more and more relevant to our everyday life. Reflecting this tendency in the scientific community, alternative metrics for measuring scholarly impact on the web are increasingly proposed, extending (or even replacing) traditional metrics (e.g., citations, journal impact factor, etc.). This paper explores the relationship between traditional metrics and alternative metrics for psychological research in the years from 2010 to 2012. Traditional publication metrics (e.g., number of citations, impact factor) and alternative metrics (collected from Altmetric, a website that collects and counts references as they appear in Wikipedia, public policy documents, research blogs, mainstream media, or social networks) were extracted and compared, using a dataset of over 245,000 publications from the Web of Science. Results show positive, small to medium, correlations on the level of individual publications, and frequently medium to high correlations on the level of research fields of Psychology. The more accumulated the level of analysis, the higher the correlations. These findings are fairly robust over time and comparable to findings from research areas other than Psychology. Additionally, a new metric, the Score Factor, is proposed as a useful alternative metric to assess a journal’s impact in the online media.

  • Research Article
  • 10.1097/iop.0000000000003072
Thyroid Eye Disease Research From 2010 to 2024: An Analysis of Social Media Impact Versus Traditional Citation Metrics.
  • Sep 11, 2025
  • Ophthalmic plastic and reconstructive surgery
  • Aaron T Zhao + 1 more

To analyze the relationship between traditional bibliometric measures and Altmetric Scores for articles on thyroid eye disease, examining their scientific and social media impact from 2010 to 2024. We analyzed the 100 most-cited articles on thyroid eye disease from the Web of Science Core Collection, comparing traditional citation metrics with Altmetric Attention Scores. Statistical analyses included Spearman correlation, temporal trend analysis, and comparison of impact patterns across journals and publication years. Among the top 100 cited articles, we found a moderate positive correlation between citations and Altmetric Scores (r = 0.350, p = 0.002). Only 8% of articles achieved high impact in both metrics (>Q3). The median citation count was 40 (interquartile range: 32-59; range: 26-531), while the median Altmetric Score was 3 (interquartile range: 1-10; range: 1-546). Recent articles (2020-2024) showed significantly higher Altmetric Scores compared with earlier periods (median: 11 vs. 1, p < 0.0001). Open access articles demonstrated higher impact in both metrics compared with subscription-based articles. Traditional citation metrics and social media impact measures capture different aspects of research influence in thyroid eye disease literature. The emergence of high-impact therapeutic studies, particularly regarding teprotumumab, demonstrates how breakthrough research can achieve substantial impact across both traditional and alternative metrics. Given the increasing role of social media in research dissemination and patient education, clinicians should consider both traditional and alternative metrics when evaluating research impact and should be prepared to discuss studies that achieve high social media engagement with patients.

  • Research Article
  • 10.1097/scs.0000000000011420
Exploring the Relationship Between Altmetric Attention Scores and Citations: A Study Based on Articles Published in the Journal of Craniofacial Surgery.
  • Apr 25, 2025
  • The Journal of craniofacial surgery
  • Burak Erkmen + 4 more

This study investigates the relationship between Altmetric Attention Scores (AAS) and traditional citation metrics for articles published in the Journal of Craniofacial Surgery between 1990 and 2025. Bibliometric analyses are commonly used to assess the impact and productivity of scientific studies. However, the growing role of social media platforms in academic dissemination has led to the emergence of alternative metrics like AAS, which measure online engagement and attention. A search conducted on the Dimensions website identified 17,232 articles published during the study period. Of these, 228 articles had an AAS of 5 or higher. The highest AAS values were predominantly associated with articles published in the last decade. Metrics such as the Field Citation Ratio (FCR) and Relative Citation Ratio (RCR) were analyzed alongside AAS values. The top 10 articles with the highest AAS showed that there was no statistical correlation between AAS and traditional citation metrics, including citation count, FCR, and RCR. The findings indicate that although altmetric analyses provide valuable insights into the online visibility of articles, they should be used in conjunction with traditional bibliometric methods for a comprehensive evaluation of scholarly impact. The study also underscores the need for further research to understand the interplay between social media engagement and academic citations. This research contributes to the ongoing discourse on the utility of altmetrics in complementing traditional metrics and provides insights for evaluating the multifaceted impact of scientific publications.

  • PDF Download Icon
  • Research Article
  • Cite Count Icon 3
  • 10.1051/epjconf/201818605002
Astronomy in Chile: Assessment of scientific productivity through a bibliometric analysis
  • Jan 1, 2018
  • EPJ Web of Conferences
  • Rodrigo Cortes + 2 more

The skies of Northern Chile are considered among the best in the world for astronomy due to their geographical, climatic and atmospheric conditions. In fact, during the last several decades, a great number of astronomical observatories have been built by space research institutions devoted to space research, turning Chile into one of the countries with the greatest astronomical observation capacity in the world. Consequently, it is relevant to explore and assess the development of astronomy in Chile during the last ten years (2005-2015), carrying out a bibliometric analysis to extract traditional metrics, complemented with alternative metrics, to identify the Chilean production and scientific contribution of research in this field of knowledge. The results from traditional metrics, based on the information obtained in the Web of Science (WoS) database analyzed through InCites for the Astronomy &amp; Astrophysics category indicate a sustained increase of the scientific production for the discipline during the last ten years. In particular, the Normalized Citation Impact of organizations and institutions conducting research in Chile is above the worldwide average. On the other hand, the alternative metrics, including for instance, the altmetrics types presented by the SCOPUS database, reflect that the Chilean research impact is much lower in the context of social networks.

  • Research Article
  • Cite Count Icon 2
  • 10.1177/0886260516657914
Knowledge Dissemination of Intimate Partner Violence Intervention Studies Measured Using Alternative Metrics: Results From a Scoping Review.
  • Jul 4, 2016
  • Journal of interpersonal violence
  • Kim Madden + 8 more

Alternative metrics measure the number of online mentions that an academic paper receives, including mentions in social media and online news outlets. It is important to monitor and measure dispersion of intimate partner violence (IPV) victim intervention research so that we can improve our knowledge translation and exchange (KTE) processes improving utilization of study findings. The objective of this study is to describe the dissemination of published IPV victim intervention studies and to explore which study characteristics are associated with a greater number of alternative metric mentions and conventional citations. As part of a larger scoping review, we conducted a literature search to identify IPV intervention studies. Outcomes included znumber of alternative metric mentions and conventional citations. Fifty-nine studies were included in this study. The median number of alternative metric mentions was six, and the median number of conventional citations was two. Forty-one percent of the studies (24/59) had no alternative metric mentions, and 27% (16/59) had no conventional citations. Longer time since publication was significantly associated with a greater number of mentions and citations, as were systematic reviews and randomized controlled trial designs. The majority of IPV studies receive little to no online attention or citations in academic journals, indicating a need for the field to focus on implementing strong knowledge dissemination plans. The papers receiving the most alternative metric mentions and conventional citations were also the more rigorous study designs, indicating a need to focus on study quality. We recommend using alternative metrics in conjunction with conventional metrics to evaluate the full dissemination of IPV research.

  • Research Article
  • Cite Count Icon 2
  • 10.1177/23259671231166701
Relationship of Altmetric Attention Score, Twitter Performance, and Dimensions Badge Value With Traditional Metrics in Top-Cited Anterior Cruciate Ligament Research Studies
  • May 1, 2023
  • Orthopaedic Journal of Sports Medicine
  • Hasan Basri Sezer + 4 more

Background:Alternative citation metrics—such as the Altmetric Attention Score (AAS), number of tweets (TN), and dimensions badge value (DBV)—are emerging as new options for assessing the value of scientific works.Purpose:To analyze the AAS of highly cited articles on the anterior cruciate ligament (ACL) and to assess the relationship between alternative and traditional metrics such as journal rankings and article citation performance.Study Design:Cross-sectional study.Methods:A search was conducted using the Web of Science Core Collection of databases with “anterior cruciate ligament” as the search term. Full-text articles published between 2011 and 2021 were reviewed, and the top 100 cited articles were determined. The articles were analyzed by publication year, study design, research topic, journal impact factor, journal h-index, number of total citations (TC), recent citations (RC) (ie, citations in the latest 2 years), and average citation per year (ACY), as well as AAS, TN, and DBV.Results:For articles in the top 100 list, the median TC was 160 (interquartile range [IQR], 117-561) and the median AAS was 24.50 (IQR, 1-730). A higher AAS score was achieved by articles on return to sports and anterolateral ligament (P < .05). The AAS and TN were significantly and positively correlated with the RC (r = 0.459 and P = .001; r = 0.438 and P = .001, respectively) and ACY (r = 0.363 and P = .001; r = 0.393 and P = .001, respectively).Conclusion:Alternative metrics were linked to traditional metrics but were not a direct representation of bibliometrics. The AAS was not correlated with TC numbers in the ACL research. Higher AAS and Twitter popularity of an article were related to receiving high-volume RC performance. The DBV represented a stronger correlation with traditional metrics than the AAS.

  • Research Article
  • Cite Count Icon 3
  • 10.1007/s10067-021-05901-6
Highly cited papers in Takayasu arteritis on Web of Science and Scopus: cross-sectional analysis.
  • Sep 4, 2021
  • Clinical Rheumatology
  • Durga Prasanna Misra + 4 more

Takayasu arteritis (TAK) is a large vessel vasculitis affecting relatively younger population. Since literature on bibliometric analysis of TAK is scarce, we analyzed top-cited articles in TAK to address this knowledge gap. We analyzed the top hundred cited articles in TAK on Web of Science and Scopus for time of publication, article type, country of origin, source journal, and authors. Furthermore, we conducted univariable- and multivariable-adjusted linear regression analyses to explore associations of rank of cited articles, mean number of annual citations, and total citations with traditional (journal impact factor, CiteScore) and alternative (PlumX) metrics. Concordance between databases was 76%. Most top-cited articles were from the USA, Japan, or the UK, and published in Annals of the Rheumatic Diseases, Arthritis and Rheumatism, and Circulation and Rheumatology (Oxford). Original articles comprised a majority of these top-cited articles. Articles describing criteria or disease management recommendations received the highest mean number of citations. Performing multivariable-adjusted linear regression analyses, years of publication associated with mean annual citations on Web of Science as well as total citations across databases (p < 0.01). The 2-year JIF significantly associated with mean annual citations on Web of Science (p = 0.047). On Scopus, the number of captures denoted under PlumX metrics consistently associated with citations (p < 0.001). Both traditional and alternative metrics associate with higher citations in TAK. Development of disease assessment and clinical practice guidelines and conduct and reporting of randomized controlled trials to guide TAK management are important research areas. The key points themselves are all right. Key Points • A majority of top-cited papers in TAK are original articles. • Both traditional and alternative metrics associate with number of citations for these papers. • Recommendations for disease assessment or clinical practice and clinical trials are important research agenda in TAK.

  • Research Article
  • Cite Count Icon 1
  • 10.3760/cma.j.cn121094-20220630-000350
Bibliometric and visual analysis of pneumoconiosis based on Cite Space
  • Jan 20, 2024
  • Zhonghua lao dong wei sheng zhi ye bing za zhi = Zhonghua laodong weisheng zhiyebing zazhi = Chinese journal of industrial hygiene and occupational diseases
  • C H Zeng + 3 more

Objective: Through the bibliometrics analysis and visual analysis of Chinese and English literature related to pneumoconiosis through CiteSpace, to understand the research situation, research trend and hotspots of pneumoconiosis, so as to provide reference for further research. Methods: In August 2022, CNKI (China National Knowledge Infrastructure) data baseand Web of Science core collection database were used as data sources for literature retrieval. Cite Space.5.8.R3c software was used to analyze the cooperation between authors and institutions, keyword co-occurrence analysis, keyword clustering analysis and keyword emergence analysis. Results: A total of 4726 Chinese literature and 2490 English literature related to pneumoconiosis were included; The annual publication volume of Chinese literature shows a fluctuating downward trend, while the annual publication volume of English literature shows a fluctuating upward trend. The Institute of Labor Health and Occupational Disease of the Chinese Academy of Preventive Medical Sciences and the Institute of Occupational Health and Poisoning Control of the Chinese Center for Disease Control and Prevention have the highest publication volume (55 articles) in the institutional cooperation network; The National Institute for Occupational Safety and Health (NIOSH) in the United States has the highest publication volume (153 articles) in the institutional collaboration network. The results of keyword co-occurrence, clustering, and prominence analysis show that Chinese literature focuses more on clinical research on pneumoconiosis, while English literature focuses more on experimental research related to the pathogenesis of pneumoconiosis. Conclusion: In the related field of pneumoconiosis research, the experimental research and clinical research on the pathogenesis are the main research hotspots.

  • Research Article
  • Cite Count Icon 2
  • 10.4995/ijpme.2025.21900
Empowering human resource management through artificial intelligence: A systematic literature review and bibliometric analysis
  • Jan 31, 2025
  • International Journal of Production Management and Engineering
  • Adil Benabou + 1 more

Drawing on a systematic literature review and bibliometric analysis, this article examines the burgeoning field of Artificial Intelligence (AI) integration into Human Resource Management (HRM) practises. By evaluating 77 selected articles from two extensive databases, Scopus and Web of Science, this study illuminates the dynamic intersection of AI technologies and HRM, encapsulating the profound implications for organisational and individual aspects of HR practises. This analysis delineates three primary thematic areas: AI's transformative role in HRM, the emerging paradigm of human-AI collaboration, and the nuanced challenges and opportunities presented by AI in HR practises. This research contributes to the academic discourse by mapping the current state of AI applications in HRM, identifying gaps and proposing directions for future research, emphasising the need for ethical frameworks and the strategic integration of AI to enhance HR practises. Through this scholarly endeavour, we aim to offer a comprehensive overview that aids practitioners and researchers in navigating the complexities of AI's role in reshaping HRM towards more efficient, ethical, and innovative practises.

Save Icon
Up Arrow
Open/Close
  • Ask R Discovery Star icon
  • Chat PDF Star icon

AI summaries and top papers from 250M+ research sources.