Citation Scores Research Articles

Examining national citation impact by comparing developments in a fixed and a dynamic journal set

In order to examine potential effects of methodological choices influencing developments in relative citation scores for countries, a fixed journal set comprising of 3232 journals continuously indexed in the Web of Science from 1981 to 2014 is constructed. From this restricted set, a citation database depicting the citing relations between the journal publications is formed and relative citation scores based on full and fractional counting are calculated for the whole period. Previous longitudinal studies of citation impact show stable rankings between countries. To examine such findings coming from a dynamic set of journals for potential “database effects”, we compare them to our fixed set. We find that relative developments in impact scores, country profiles and rankings are both very stable and very similar within and between the two journal sets as well as counting methods. We do see a small “inflation factor” as citation scores generally are somewhat lower for high-performing countries in the fixed set compared to the dynamic set. Consequently, using an ever-decreasing set of journals compared to the dynamic set, we are still able to reproduce accurately the developments in impact scores and the rankings between the countries found in the dynamic set. Hence, potential effects of methodological choices seem to be of limited importance compared to the stability of citation networks.

Scientific Quality Index: a composite size-independent metric compared with h-index for 480 medical researchers

The goal of this study was to measure the scientific output of 480 authors—leaders in 12 selected branches of medicine, using the Hirsch index (the h-index) and a newly proposed Scientific Quality Index (SQI). Data were collected from the Scopus database (2008–2017) and scientific output assessments, by the h-index were compared with those by SQI. SQI is calculated by the addition of the percentage of papers cited ≥ 10 times and the mean citation score (excluding self-citations and the citations of all co-authors for both). The following mean values of basic bibliometric parameters were obtained in the whole study group: the citation index: 7250 ± 7817, the total number of papers: 187 ± 104, the total number of cited papers: 175 ± 101, the number of papers cited at least 10 times: 110 ± 75, the percent of papers cited at least 10 times: 51 ± 16, the mean number of citations per paper: 28 ± 21. The mean value of the h-index was 33.2 ± 16.1 and the mean SQI was 78.5 ± 33.4. When ranked, according to the SQI, 279 (58.1%) authors decreased, while 199 (41.5%) improved their ranking position in comparison to the h-index scores. When correlated with the basic bibliometric parameters, SQI was less dependent on both the number of publications and the number of citations in comparison with the h-index. The SQI was strongly influenced by the mean citation score, followed by the percent of papers cited ≥ 10 times. The h-index correlated with the SQI, r = 0.73, p < 0.0001. Although strongly correlating, the h-index and the SQI reflect partially different aspects of individual scientific output. The SQI expresses mainly the qualitative features of scientific output, whereas the h-index is more influenced by its quantitative measures (the number of papers and the number of citations). Therefore, the SQI may be approached as an interesting alternative way for assessment of the scientific output of an individual researcher.

Expected, observed and relative paper scores from heterogeneous author-paper-citation networks

We explore a dual score system that simultaneously evaluates the relative importance of authors and their papers from a given author-paper-citation heterogeneous network. An observed, or actual citation score for each paper is known at the paper–paper citation matrix level. From an author score obtained from an author–author citation matrix, it is possible to derive separately, an expected score for each paper. The ratio of observed to expected scores is an author based relative paper score for each paper. If the aggregation is journal based, then based on journal scores, one can derive in the same manner, expected, observed and relative paper citation scores. It follows that field based aggregation will lead to a similar family of field based paper scores.

Using Citation Context to Improve the Retrieval of Research Article from Cancer Research Journals

Objective:In recent years, citation analysis tools provide many devices for finding or computing the citation score or impact factor for journals. It is important for the researchers to identify good journals for collecting research ideas discussed. A journal with a good impact factor value is preferably referred to by many researchers. In this research work, the author proposes a system for ranking journals on the basis of ideas and results cited in other papers.Methods:The work involves the cited content extractor for extracting the descriptive features mentioned about the cited paper. The cited content refers to the content in the article written by a citing paper and relating to the cited paper. The ranking system uses a citation score estimator for computing the overall weight of the descriptive cited content relating to a specific paper in the citing papers. The journal ranking system performs classification of the citation content with the evaluation of a citation score. The work that involves the citation content is classified under different categories as positively cited, negatively cited or neutral and unrelated.Results:Then the computed citation score is used for ranking the dealing with research on cancer research journals. The results of the ranking journals indicate that the particular ranked journal has been cited in the literature of many journals with a good descriptive content. Journal ranking system can be considered as a well-organized tool for ranking the cancer research scientific journal based on citation content and citation counting.Conclusion:This experimental cancer journal ranking method increases accuracy and effectiveness by using the citation content when compared with PageRank and HITS.

For whom do we write?

For whom do we write?

On the interplay between normalisation, bias, and performance of paper impact metrics

Abstract We evaluate article-level metrics along two dimensions. Firstly, we analyse metrics’ ranking bias in terms of fields and time. Secondly, we evaluate their performance based on test data that consists of (1) papers that have won high-impact awards and (2) papers that have won prizes for outstanding quality. We consider different citation impact indicators and indirect ranking algorithms in combination with various normalisation approaches (mean-based, percentile-based, co-citation-based, and post hoc rescaling). We execute all experiments on two publication databases which use different field categorisation schemes (author-chosen concept categories and categories based on papers’ semantic information). In terms of bias, we find that citation counts are always less time biased but always more field biased compared to PageRank. Furthermore, rescaling paper scores by a constant number of similarly aged papers reduces time bias more effectively compared to normalising by calendar years. We also find that percentile citation scores are less field and time biased than mean-normalised citation counts. In terms of performance, we find that time-normalised metrics identify high-impact papers better shortly after their publication compared to their non-normalised variants. However, after 7 to 10 years, the non-normalised metrics perform better. A similar trend exists for the set of high-quality papers where these performance cross-over points occur after 5 to 10 years. Lastly, we also find that personalising PageRank with papers’ citation counts reduces time bias but increases field bias. Similarly, using papers’ associated journal impact factors to personalise PageRank increases its field bias. In terms of performance, PageRank should always be personalised with papers’ citation counts and time-rescaled for citation windows smaller than 7 to 10 years.

The influence of highly cited papers on field normalised indicators

Field normalised average citation indicators are widely used to compare countries, universities and research groups. The most common variant, the Mean Normalised Citation Score (MNCS), is known to be sensitive to individual highly cited articles but the extent to which this is true for a log-based alternative, the Mean Normalised Log Citation Score (MNLCS), is unknown. This article investigates country-level highly cited outliers for MNLCS and MNCS for all Scopus articles from 2013 and 2012. The results show that MNLCS is influenced by outliers, as measured by kurtosis, but at a much lower level than MNCS. The largest outliers were affected by the journal classifications, with the Science-Metrix scheme producing much weaker outliers than the internal Scopus scheme. The high Scopus outliers were mainly due to uncitable articles reducing the average in some humanities categories. Although outliers have a numerically small influence on the outcome for individual countries, changing indicator or classification scheme influences the results enough to affect policy conclusions drawn from them. Future field normalised calculations should therefore explicitly address the influence of outliers in their methods and reporting.

Authorship Pattern of Rain Water Harvesting Research Management Publications

The purpose of the current study is to identify the authorship pattern of the publications in the field of rain water harvesting management during the period 2008 to 2017.The study was conducted based on the bibliographic data collected from the web of science database during the period 2008 to 2017. ‘Rainwater Harvesting’ and ‘Rainwater Harvesting Management’ are the search terms researcher used to collect the data for the study. A total of 1070 records retrieved, and it is identified that a total of 3994 authors has contributed to the research in this field during the period of study. Study output shows a clear dominance of increase of the trend towards collaborative research. Author productivity was higher from 2008 to 2010. The year 2009 got a maximum number of Global Citation Score with the value 1894. The highest Local Citation Score got in the year 2010 with a value of 662; Villarreal EL is the highly cited reference during the period of study; the study period average author per publication is (AAPP) is 3.61; the average productivity per author (PPA) is 0.28.

The impact of transnational co-authorship on the scientific quality of academic researchers-Case Studies: Slovenia, Poland and Romania

Abstract The aim of this article is to contribute to the discussion about whether the scientific impact of an academic researcher (measured through bibliometrics indices as Hirsch score, citation scores or quantitative data about publications) can be accounted for by the presence of co-authors and the characteristics of the personal networks they are embedded in. With my study, I intend to demonstrate that there is statistical evidence between international co-authorship, measured through the number and the characteristics of international co-authors and the scientific impact of the researcher. Recent studies using bibliometrics and scientometrics approach shows that papers published with international co-authors may result in a higher citation rate than the ones written in a purely national manner (with national co-authors) (Glanzel &amp; Schubert, 2001; Schmoch &amp; Schubert, 2008). In the literature that addresses these issues, the main focus is put on international co-authorship, but my opinion is that the concept has undergone a series of methodological changes. I address these changes as a trend towards a transnational perspective. I explored the personal networks of university researchers, from three academic communities in the field of sociology. I analyzed the data using hierarchical regression models. This article is based on secondary data analysis starting from the data Hâncean used in 2016 (Hâncean &amp; Perc, 2016). The data provided attribute and relational data for the focal nodes and their corresponding alters from Web of Science platform. Given the theoretical framework proposed by previous research (Adams, 2012; Hâncean &amp; Perc, 2014; Glanzel &amp; Schubert, 2004), I expected the scientific impact of an author to be positively influenced by the impact of the personal network he is embedded in. After running the analysis, the presence of transnational co-authors has a moderate impact on the citation distribution, especially for the Romania case. The biggest impact on the citation distribution, for all academic communities I included in the analysis, are the number of publications and the average number of co-authors’ citations. The description and the exploration of the data in all three communities of academic sociologists (Romania, Poland and Slovenia) will be used later in order to show new ways in which knowledge is transferred through the lens of a transnational perspective.

Incremental History of the Congenital Heart Surgeons' Society (2014-2018).

The history of the first 41 years of the Congenital Heart Surgeons Society (CHSS) was recorded in 2015 which chronicled the metamorphosis of a small informal meeting into a mature organization with bylaws, officers, committees, funded research, the Kirklin-Ashburn Fellowship, and a vision to become the premier organization of congenital heart surgery in North America. Chief among these transformations was the implementation and development of the CHSS Data Center. Member participation, fellowship education, and significant outcomes research have been the hallmark of the CHSS. This incremental historical review highlights continued CHSS sentinel advances. Fifty-three CHSS Data Center manuscripts have been published. Citation scores (number of literature citations that each manuscript has accrued) have been collated and analyzed by cohort study. The average citation score for all manuscripts was 75.4 ± 76.3 (range: 1-333). The Kirklin/Ashburn Fellowship continues to thrive with academic achievements and generous contributions to the endowment. The World Journal of Pediatric and Congenital Heart Surgery has been adopted as the official organ of the CHSS. A Past President's Dinner has been inaugurated serving as a senior advisory committee to the Executive Council. Toronto Work Weekends continue. Congenital Heart Surgeons Society growth has accrued to 159 active members and 82 institutional members. Future considerations include the size, content, and duration of the annual meeting; the potential for increased membership; and political penetrance into national cardiothoracic governing organizations regarding committee appointments, executive council representation, and education initiatives. Congenital Heart Surgeons Society has achieved numerous advances during this incremental period.

Mapping diabetes research in Middle Eastern countries during 2007-2013: A scientometric analysis

Background: Scientometric studies are highly important, as they provide information about scientific products worldwide and empower scientists to compare research activities in different regions. The present study was conducted to map scientific research in diabetes mellitus using scientometric analysis in Middle Eastern countries during 2003- 2007. Methods: This was an analytical study with a scientometric approach. The study population was formed by the indexed scientific results of diabetes mellitus in the Web of Science database during 2007-2013. Data were analyzed using Excel, and HistCite to map the scientific texts. Results: A total of 6532 records were retrieved from 3926 institutions. These records belonged to 19 323 authors and were published in 1420 journals. The Journal of Diabetes Care, with 3928 citations, had the most global citation score (GCS). The Journal of Diabetes Research and Clinical Practice, with 185 citations, achieved the first degree of local citation score (LCS). Most of the scientific documents produced in the Middle East belonged to Turkey (31.91%) and Iran (21.7%). Seven scientific clusters based on LCS, and 5 based on GCS existed in the scientific mapping. Topical clusters based on global and local indices showed that the prevalence of diabetes, hyperglycemia, and pregnancy outcomes, diabetic risk factors, diabetic complications and their new treatments, and glucose monitoring in Type 1 diabetes were the fields being addressed in the main articles of the clusters. Conclusion: Scientific production and local and global citations in diabetes research in Iran (21.7% of diabetes research in the Middle East) have elevated the country to a prominent position. Top ranking countries in diabetic research were Turkey, Iran, and Israel, respectively. Moreover, this paper quantified the studies that were done on different aspects of diabetes. The results of this study can be used by health care providers to employ the best multidisciplinary approach for managing diabetes and its complications. Also, the results can help the policy-makers and governments to determine the priorities for budget allocation based on the burden of diseases. Establishing a regional diabetes network in the Middle East can be beneficial and lead to scientific collaboration and an increase in scientific production in this field.

Algorithmically generated subject categories based on citation relations: An empirical micro study using papers on overall water splitting

One important reason for the use of field categorization in bibliometrics is the necessity to make citation impact of papers published in different scientific fields comparable with each other. Raw citations are normalized by using field-normalization schemes to achieve comparable citation scores. There are different approaches to field categorization available. They can be broadly classified as intellectual and algorithmic approaches. A paper-based algorithmically constructed classification system (ACCS) was proposed which is based on citation relations. Using a few ACCS field-specific clusters, we investigate the discriminatory power of the ACCS. The micro study focusses on the topic "overall water splitting" and related topics. The first part of the study investigates intellectually whether the ACCS is able to identify papers on overall water splitting reliably and validly. Next, we compare the ACCS with (1) a paper-based intellectual (INSPEC) classification and (2) a journal-based intellectual classification (Web of Science, WoS, subject categories). In the last part of our case study, we compare the average number of citations in selected ACCS clusters (on overall water splitting and related topics) with the average citation count of publications in WoS subject categories related to these clusters. The results of this micro study question the discriminatory power of the ACCS. We recommend larger follow-up studies on broad datasets.

Examination of China's performance and thematic evolution in quantum cryptography research using quantitative and computational techniques.

This study performed two phases of analysis to shed light on the performance and thematic evolution of China’s quantum cryptography (QC) research. First, large-scale research publication metadata derived from QC research published from 2001–2017 was used to examine the research performance of China relative to that of global peers using established quantitative and qualitative measures. Second, this study identified the thematic evolution of China’s QC research using co-word cluster network analysis, a computational science mapping technique. The results from the first phase indicate that over the past 17 years, China’s performance has evolved dramatically, placing it in a leading position. Among the most significant findings is the exponential rate at which all of China’s performance indicators (i.e., Publication Frequency, citation score, H-index) are growing. China’s H-index (a normalized indicator) has surpassed all other countries’ over the last several years. The second phase of analysis shows how China’s main research focus has shifted among several QC themes, including quantum-key-distribution, photon-optical communication, network protocols, and quantum entanglement with an emphasis on applied research. Several themes were observed across time periods (e.g., photons, quantum-key-distribution, secret-messages, quantum-optics, quantum-signatures); some themes disappeared over time (e.g., computer-networks, attack-strategies, bell-state, polarization-state), while others emerged more recently (e.g., quantum-entanglement, decoy-state, unitary-operation). Findings from the first phase of analysis provide empirical evidence that China has emerged as the global driving force in QC. Considering China is the premier driving force in global QC research, findings from the second phase of analysis provide an understanding of China’s QC research themes, which can provide clarity into how QC technologies might take shape. QC and science and technology policy researchers can also use these findings to trace previous research directions and plan future lines of research.

Creative Corporate Culture and Innovation

We define creative companies by means of the Competing Value Framework, and we identify them by means of textual analysis. We show that a creative corporate culture is an important driver of innovation, as measured by the number of patents a firm files for as well as the patents’ importance (captured by patents’ citation scores). Creative firms are able to reach a higher firm value from their investment in innovation. The potential bias induced by omitted variables is then addressed by estimating the additional patents, patent citations, and value generated by creative firms after state-induced tax incentives on R&D in a differences-in-differences framework.

Worldwide Scientific Trends on Ochratoxin-A During 1965–2016

The contamination in foodstuff by ochratoxin A (OTA) has become a major problem to humans and animals. Hence, many countries have expressed interest on researching OTA. However, the current development trends of OTA are not well understood. This study discussed the research trends and hotspots of OTA and investigated the contribution of research from seven areas: countries, institutions, authors, publications, subject categories, keywords and journals. Related publications on OTA during 1965–2016 were retrieved from the Web of Science database. CiteSpace V and bibliometric technologies combined with network analysis were used in exploring research hotspots and basic statistics of OTA. A total of 4889 articles, which were contributed from 103 countries, were identified. Most countries are from Europe, such as Italy, Germany and France. The USA, which ranks first, accounts for 11.1% of the articles with 543 records. Additionally, the top three high-cited countries are Denmark, the Netherlands and Austria, all from Europe. Surprisingly, China has a large number of publications which accounts for 6 but lesser citation scores. In the subject of nutrition and dietetics, keywords ‘aptamer’ and ‘biosensor’ are emerging, which are of increasing concern. This finding indicated that the literature growth in the field of OTA would be expanding rapidly in the future. European countries are the most influential countries, especially Denmark, the Netherlands and Austria. New technologies for detecting and identifying OTA as well as nutrition and dietetics would be paid more attention by scholars or the society.

Sequence analysis of annually normalized citation counts: an empirical analysis based on the characteristic scores and scales (CSS) method

In bibliometrics, only a few publications have focused on the citation histories of publications, where the citations for each citing year are assessed. In this study, therefore, annual categories of field- and time-normalized citation scores (based on the characteristic scores and scales method: 0 = poorly cited, 1 = fairly cited, 2 = remarkably cited, and 3 = outstandingly cited) are used to study the citation histories of papers. As our dataset, we used all articles published in 2000 and their annual citation scores until 2015. We generated annual sequences of citation scores (e.g., left{ {01233233221} right}) and compared the sequences of annual citation scores of six broader fields (natural sciences, engineering and technology, medical and health sciences, agricultural sciences, social sciences, and humanities). In agreement with previous studies, our results demonstrate that sequences with poorly cited (0) and fairly cited (1) elements dominate the publication set; sequences with remarkably cited (3) and outstandingly cited (4) periods are rare. The highest percentages of constantly poorly cited papers can be found in the social sciences; the lowest percentages are in the agricultural sciences and humanities. The largest group of papers with remarkably cited (3) and/or outstandingly cited (4) periods shows an increasing impact over the citing years with the following orders of sequences: left{ {0123} right} (6.01%), which is followed by left{ {123} right} (1.62%). Only 0.11% of the papers (n = 909) are constantly on the outstandingly cited level.

Mendeley readership as a filtering tool to identify highly cited publications

This study presents a large‐scale analysis of the distribution and presence of Mendeley readership scores over time and across disciplines. We study whether Mendeley readership scores (RS) can identify highly cited publications more effectively than journal citation scores (JCS). Web of Science (WoS) publications with digital object identifiers (DOIs) published during the period 2004–2013 and across five major scientific fields were analyzed. The main result of this study shows that RS are more effective (in terms of precision/recall values) than JCS to identify highly cited publications across all fields of science and publication years. The findings also show that 86.5% of all the publications are covered by Mendeley and have at least one reader. Also, the share of publications with Mendeley RS is increasing from 84% in 2004 to 89% in 2009, and decreasing from 88% in 2010 to 82% in 2013. However, it is noted that publications from 2010 onwards exhibit on average a higher density of readership versus citation scores. This indicates that compared to citation scores, RS are more prevalent for recent publications and hence they could work as an early indicator of research impact. These findings highlight the potential and value of Mendeley as a tool for scientometric purposes and particularly as a relevant tool to identify highly cited publications.

BIBLIOMETRIC MAPPING OF “INDIAN JOURNAL OF PEDIATRICS” 2007-2016

The aim of this paper is a special reference to the research productivity of a journal called “Indian Journal of Pediatrics”. The source and citation data have been downloaded from the Web of Science (WoS) database of Thomson–Reuters. Totally 2980 records were published by this journal. This study made an effort to measure the year wise distribution of publications, document wise distribution of publications, institution wise distribution of publications and the country wise distribution of publications. The result resolves the number of total global citation score for above mentioned ten year records. The mapping work has done by using the software VOSviewer for analysing the records of this journal. In further the Histograph analysis made by Histcite software.

How do NIHR peer review panels use bibliometric information to support their decisions?

Bibliometrics is widely used as an evaluation tool to assist prospective R&D decision-making. In the UK, for example, the National Institute for Health Research (NIHR) has employed bibliometric analysis alongside wider information in several awarding panels for major funding schemes. In this paper, we examine various aspects of the use of bibliometric information by members of these award selection panels, based on interviews with ten panel members from three NIHR panels, alongside analysis of the information provided to those panels. The aim of the work is to determine what influence bibliometrics has on their decision-making, to see which types of bibliometric measures they find more and less useful, and to identify the challenges they have when using these data. We find that panel members broadly support the use of bibliometrics in panel decision-making, and that the data are primarily used in the initial individual assessment of candidates, playing a smaller role in the selection panel meeting. Panel members felt that the most useful measures of performance are normalised citation scores and the number or proportion of papers in the most highly cited X% (e.g. 5, 10%) for the field. Panel members expressed concerns around the comparability of bibliometrics between fields, but the discussion suggested this largely represents a lack of understanding of bibliometric techniques, confirming that effective background information is important. Based on the evidence around panel behaviour and concerns, we set out guidance around providing bibliometrics to research funding panels.

A Scientometric Analysis of Astrophysics Research Output in India: Study Based on Web of Science

This study analyzes the Astrophysics research output in India from the year 1989-2014. The data was downloaded from web of science database which was maintained by Thomson Reuters. The findings of the study revealed that The highest number of publications is in the year 2013 with 913 records having a Global Citation score 4342 and Local Citation Score of 324.The study shows that major source of publication in Astrophysics research comes in the form of articles . The study also applied statistical tools such as K-S Test, Price’s Square root law and Pareto Principle (80 X 20 Rule).