Altmetrics for Research Impact Actuation (ARIA): An Impact Tracking Tool for Multidisciplinary and Role-based Cross-Metric Analysis

Abstract

Altmetrics are new-age research impact metrics that hold the promise of looking beyond the traditional methods of measuring research impact. Altmetrics are real-time metrics that show the outreach of scientific research among an audience from different academic and non-academic backgrounds. Several altmetric systems have been developed in the last few years, either as a cumulative exploratory tool that showcases the different metrics from the various altmetric sources, or as part of existing publisher systems and databases. In the first part of this study, we have analyzed features of nine different altmetric systems, two academic social networking systems, and five other types of systems, including digital libraries, publisher systems, and databases. Results of a feature analysis indicated that the overall coverage of individual features by the systems is moderate, with maximum coverage being 27 out of 33 features analyzed. Features like the visualization of metrics, altmetric sources and bibliometric sources were not found in many systems. Identified gaps were later implemented in the second part of the study, wherein we developed a prototype system, called Altmetrics for Research Impact Actuation (ARIA). We also conducted a user evaluation study of the prototype, the outcome of which was used to improve certain features of ARIA based on user feedback.