Research Performance Evaluation Research Articles

Improvement and Experiment for Online Measurement of Droplet Mass Deposit

HighlightsA measurement device for droplet mass deposit was improved to enhance its performance.A wireless data transmission system was used to achieve convenient data sharing.A user interface was designed for display and analysis of the measurement results.A positioning mechanism was designed for arranging measurement devices promptly.Abstract. Measurement of droplet mass deposit is important in spray research and spray performance evaluation. In this article, an online measurement device for droplet mass deposit was improved based on the original design. The measurement resolution, precision, and data stability were improved by optimization of the structure and components and by data filtering. The resolution reached 0.00067 mg cm-2. Comparison tests showed that the relative error between the original device and an analytical balance was 6.68% to 8.48%, and the relative error between the improved device and the analytical balance was 5.24% to 6.15%. Compared with the original device, the relative error decreased and the precision improved. The relative error between the improved device and a tracer method was 5.11% to 6.99%, and the precision of the improved device was close to that of the tracer method. A positioning mechanism was designed to arrange measurement devices promptly in the test area, and a wireless data transmission system was used to achieve convenient data sharing. A user interface was designed to display the results in the form of tables and contour maps. Tests were conducted to measure the droplet mass deposit distribution of one nozzle, the droplet mass deposit distribution in a tree canopy, and the uniformity of the droplet mass deposit distribution in a small horizontal area. The results showed that the improved measurement device could provide data promptly and conveniently for spray research and spray performance evaluation. Keywords: Device improvement, Mass distribution, Wireless communication.

The Incubation Mechanism and Incubation Performance Evaluation of "Co-creation Space" in Colleges and Universities

The construction of "co-creation space" in colleges and universities has created a comprehensive support platform for their students to start their own businesses, and plays an important role in implementing the innovation-driven development strategy of the country. However, china's " co-creation space " in colleges and universities started relatively late, the law of business incubation has not yet been clarified, the entrepreneurship incubation mechanism, performance evaluation and other research is relatively weak, indirectly affecting the practice of innovation and entrepreneurship guidance. The purpose of this paper is, through the study of the incubation mechanism and performance evaluation of the university's co-creation space, to provide some reference for better use of the superior resources of colleges and universities to improve the incubation efficiency and improve the quality of the incubation of the “co-creation space”. This paper analyzes the meaning of " co-creation space " and the function of incubation service in colleges and universities, and expounds the mechanism of the incubation capacity of the university's creation space, that is, the cultivation mechanism of the spirit of creation, the nesting mechanism of the entrepreneurial network, the mechanism of heterogeneous synergy of entrepreneurship, the mechanism of upgrading the incubation capacity and the interrelated role between them. Based on the meaning of the incubation mechanism of "university co-creation space", the influence factors of incubation performance are extracted, and the evaluation index system of incubation performance of "creation space" in colleges and universities is constructed on this basis. And designed a set of operational evaluation procedures. Data sources are obtained by means of questionnaires and interviews, respectively. using the scoring method of Licht's five-point scale, the incubation performance of selected case universities was tested and evaluated, the evaluation scores were obtained, and the corresponding evaluation results were determined by reference to other evaluation criteria. Reasonable suggestions are put forward for the problems found in the evaluation.

Performance and Safety Evaluation of Lithium-Ion Batteries for Electric Vehicles

Performance and safety in battery packs are the major concern in the electrification sector. However, most of the research papers provide information, covering only one or very few parameters to describe the decrement of power and safety in the battery. It leaves aside a holistic and comprehensive study to critically evaluate performance in lithium-ion battery packs. This paper presents ten performance parameters with experiments and theory undertaken to understand the influence in power and safety in lithium-ion battery packs. The influence of performance parameters will provide and integrated approach to clearly identify the problems that induce decrement in performance and compromise safety in the battery. Comprehensive research of performance evaluation in electrification is nascent today, however, when the temperature and vibration parameters are critically reviewed, it has been found that a comprehensive effort is still required to evaluate the impact of vibration and temperature loads in the power performance and safety of lithium-ion battery packs for electric vehicles.

Research of performance evaluation for aerial robot

Research of performance evaluation for aerial robot

Prestige and Independence-Controlled Publication Performance of Researchers at 14 Hungarian Research Institutions between 2014 and 2018 : A Data Paper

This data article describes a dataset showing the five-year performance of 471 researchers from 14 Hungarian research institutions, with a total of 3219 observations. Each observation represent items produced between the 1st January 2014 and the 31th December 2018 by a researcher employed in the sampled research institutions from one of six research output types. Due to a prestige and independence-controlled categorization of research output, and the scarcity of easily accessible, well-structured data curated for research performance evaluation, this dataset can play an important role in new research evaluation policies at Hungarian research institutions aiming to enhance global competitiveness by fostering scientific excellence and innovation.

Research Status and Method of Aviation Sensor Performance Evaluation

Aviation sensor is an important guarantee for aircraft safety flight, ground test and flight test accuracy and reliability. In this paper, through the analysis of the problems existing in the actual working environment of aviation sensors, the necessity of evaluating the performance of aviation sensors in the actual working environment is clarified. Combined with the comparison of the research status of the performance evaluation methods of aviation sensors at home and abroad, the development direction of the performance evaluation research of aviation sensors in the actual working environment in the future is proposed.

Machine Learning Based Computational Gene Selection Models: A Survey, Performance Evaluation, Open Issues, and Future Research Directions.

Gene Expression is the process of determining the physical characteristics of living beings by generating the necessary proteins. Gene Expression takes place in two steps, translation and transcription. It is the flow of information from DNA to RNA with enzymes’ help, and the end product is proteins and other biochemical molecules. Many technologies can capture Gene Expression from the DNA or RNA. One such technique is Microarray DNA. Other than being expensive, the main issue with Microarray DNA is that it generates high-dimensional data with minimal sample size. The issue in handling such a heavyweight dataset is that the learning model will be over-fitted. This problem should be addressed by reducing the dimension of the data source to a considerable amount. In recent years, Machine Learning has gained popularity in the field of genomic studies. In the literature, many Machine Learning-based Gene Selection approaches have been discussed, which were proposed to improve dimensionality reduction precision. This paper does an extensive review of the various works done on Machine Learning-based gene selection in recent years, along with its performance analysis. The study categorizes various feature selection algorithms under Supervised, Unsupervised, and Semi-supervised learning. The works done in recent years to reduce the features for diagnosing tumors are discussed in detail. Furthermore, the performance of several discussed methods in the literature is analyzed. This study also lists out and briefly discusses the open issues in handling the high-dimension and less sample size data.

Comprehensive Evaluation and Analysis of Teaching and Research Performance of Art Majors

The growing popularity of art majors is overshadowed by the difficulty for art graduates to find a decent job. The teaching and research (T&R) performance of art majors should be evaluated comprehensively, such as to optimize resource allocation and improve teaching quality. Based on performance evaluation theory and input-output theory, this paper summarizes the features, problems and problem causes of performance evaluation for art majors. From the dimensions of teaching and research, a comprehensive index system was designed for T&R performance evaluation of art majors. On this basis, a performance evaluation model was constructed for art majors through principal component analysis (PCA). Finally, single-factor evaluation and comprehensive evaluation were conducted by our model on the T&R performance of the school of art design and school of industrial design in a university. The results show that: The performance evaluation of art majors is a small-scale yet complex and professional task, but the current evaluation methods lack sufficient attention, professionality, and targeted indices. The school of art design had a slightly higher ratio of excellent theses than the school of industrial design, reflecting the difference between the two schools in teaching results and quality. The school of industrial design invested much more than the school of art design. Both schools had improved the T&R outputs and comprehensive performance score since 2011, and the school of industrial design made the greater improvement in the comprehensive performance score. The research sheds new light on comprehensive evaluation of T&R performance in art majors.

The Evolution and Approaches of Information Analysis Service of University Libraries in China

ABSTRACT The role of reference and information service has been redefined in some Chinese university libraries. In these libraries the focus of reference and information service has transformed into information analysis. University libraries have been a participant in the management and evaluation in scientific research, technological innovation, and discipline construction. The information analysis service of Zhejiang University Library is a typical case. Zhejiang University library established an information analysis group in 2009 in reference and information service division. To further guarantee the professionalism of service, the information analysis service center was set up in 2018 as a separate division. Over the past decade, information analysis service has played the potential of library in supporting decision-making, scientific research and innovation, discipline construction, research performance evaluation, etc. Information analysis service makes the popularity and status of the university library improve continuously. The evolution of information analysis service of Zhejiang University Library is reviewed in this paper, from the initial stage to the expansion stage, and then to the establishment of professional division. Approaches to promote the progress of information analysis service are summarized. The future goals are also discussed from the perspectives of strengthening the innovation mind-set, librarian development, and information analysis literacy.

Performance Evaluation of Energy Research Projects Using DEA Super-Efficiency

This study proposes super efficiency (SE) as an efficient analytical method for evaluating the performance of energy research projects. Because the SE method is based on data envelopment analysis (DEA), it is free from the difficulty of weighting output, allows for the use of variables with diverse standards of measurement, and is capable of providing ranking information that regular DEA (CCR, BCC) analysis techniques cannot. To analyze the feasibility of the DEA-SE method, an efficiency evaluation was performed for energy research projects using both the weighting method as an existing method and the SE method. When the results were compared and analyzed, skewing toward particular output types was observed in the weighting method, owing to problems inherent in the method itself and in the weighting of subordinate variables that make up the total performance score. Therefore, adopting DEA-SE will redress the known problems of the weighting method by minimizing the problems of weighting and skewing in outputs, enabling use of the input and output variables with diverse units and standards of measurement, and providing ranking information of research performance evaluation that is unobtainable with the existing DEA method.

Evaluating research performance of Coronavirus and Covid-19 pandemic using scientometric indicators

PurposeThis study is an attempt to evaluating the growth of scientific literature in the domain of coronavirus and Covid-19 pandemic research based on scientometric indicators: prolific countries and relative citation impact (RCI); influential institutions; author analysis and network, h-index and citation; DC (degree of collaboration), CC (collaboration coefficient), MCI (modified collaboration index) in the subject domain of coronavirus and Covid-19 research.Design/methodology/approachThe authors adopted approaches to obtain the literature data from Scopus database from 2000 to 2020 by conducting a systematic search using keywords related to the studied subject domain. In total, 15,297 numbers of records were considered for the literature analysis considering the real significant growth of this subject domain. This study presented the scientometric analysis of these publications. Furthermore, statistical correlations have been used to understand the collaboration pattern. Visualization tool VOSviewer is used to construct the co-author network.FindingsThe present study found that 53.57% (8,195) of the research documents published on the open-access platform. Journal of Virology was found to be most preferred journal by the researcher producing around 839(5.48%) articles. USA and China dominate in the research output, and the University of Hong Kong has produced the highest number of research paper 547(3.58%). A significant portion of the research documents are published in the subject domain of medicine (49.70%), followed by immunology and microbiology (35.72%), and biochemistry, genetics and molecular biology subject domains (22.32%). There has been an unparalleled proliferation of publications on COVID-19 since January 2020 and also a significant distribution of research funds across the globe.Research limitations/implicationsThe study exclusively examines 15,297 research outputs which have been indexed in the Scopus database from 2000 to 2020 (till 01 April 2020). Thus, documents published in any other different channels and sources which are not covered in Scopus are excluded from the purview of research.Practical implicationsIt will be beneficial for researchers and practitioners worldwide for understanding the growth of scientific literature in the coronavirus and COVID-19 and identifying potential collaborator.Originality/valueConsidering the global impact and social distress due to the outbreak of COVID-19 pandemic, this study is significant in the present scenario for identifying the growth of scientific literature in this field and evolving of this domain of research around the globe. The research results are useful to identify valuable research patterns from publications and of developments in the field of coronavirus and COVID-19.

Research performance evaluation of Chinese university: A non-homogeneous network DEA approach

Performance evaluation for universities or research institutions has become a hot topic in recent years. However, the previous works rarely investigate the multiple departments’ performance of a university, and especially, none of them consider the non-homogeneity among the universities’ departments. In this paper, we develop data envelopment analysis (DEA) models to evaluate the performance of general non-homogeneous decision making units (DMUs) with two-stage network structures and then apply them to a university in China. Specifically, the first stage is faculty research process, and the second stage is student research process. We first spit each DMU (i.e. department) into a combination of several mutually exclusive maximal input subgroups and output subgroups in terms of their homogeneity in both stages. Then an additive DEA model is proposed to evaluate the performance of the overall efficiency of the non-homogeneous DMUs with two-stage network structure. By analyzing the empirical results, some implications are provided to support the university to promote the research performance of each department as well as the whole university.

Estimation of the knowledge management model for performance measurement in university libraries

PurposeThe study aims to expand the literature on evaluating the performance of professionals and academic libraries, rationalizing management and providing reliable services to the academic community. The performance assessment model covers the four components (management competence, professional experience, financial add/projects and library services) in the context of the knowledge management model.Design/methodology/approachBased on quantitative data, the study defines a set of assumptions for testing the four components of performance evaluation within a knowledge management framework to develop appropriate and robust models for improving employee performance and library services. The structural equation model has been applied to sample data from 339 administrative librarians at 190 universities in Pakistan.FindingsStatistical evidence confirms that the applicability of the proposed performance-based model enhances management competence, makes accurate decisions, develops professional skills and strengthens human resource organization and knowledge management techniques in developing the efficiency of academic libraries.Practical implicationsIn the long term, academic leaders and policymakers value investment in the professional development of top library management as they participate in the decision-making process. Organizing training for service employees, supporting innovative research projects and providing library technology infrastructures ultimately improve academic performance and research when integrated into the knowledge management model.Originality/valueSo far, comprehensive literature on performance and knowledge management has been published separately. However, based on the key data collected by senior library administrators using the structured research questionnaire, the comprehensive performance evaluation research based on a knowledge management model is innovative to improve academic library services and close the literature gap.

Google Scholar and other systems for indexing scientometric indicators used by belarusian universities

Aim . To compare the effectiveness of evaluating the publication activity of organizations and authors by such indexing systems as Google Scholar, Scopus and RINTS, as well as to assess the reliability and credibility of these indexing systems in terms of measuring research performance. On the basis of this information, the reliability of the systems currently used to rank Belarusian universities, in particular the University of Grodno, was estimated. Methods . This article analyses and compares the effectiveness of various indexing systems, which is extremely relevant due to the widespread use of the Google Scholar, Scopus, and RINTS indexing systems in Belarus. Results . The general characteristics of the above-mentioned indexing systems and their significance in assessing the research performance of university staff are given. A comparative assessment of the indexing systems was carried out, including their specific features, advantages and disadvantages. The conducted analysis of the ideology and mechanism of indexing research data using Google Scholar proved the unreliability and inconsistency of this approach for evaluating research performance, as well as the fallacy of adopting this system for evaluating the publication activity of university staff. Conclusion . The analysis of the Russian Science Citation Index (RINTS) also revealed significant imperfections. However, the use of RINTS does provide a fairly objective comprehensive assessment of the publication activity of authors and organizations. In addition, RINTS enables an analysis of the structure of indicators, which is completely impossible using Google Scholar and Scopus.

Teori kritis terhadap analisis sitasi untuk kajian kuantitatif sains dan evaluasi kinerja riset

Introduction. Citation is the main indicator in research performance evaluation using the quantitative approach. There have been many criticisms of citations since they were used half a century ago, but they have not yet succeeded in bringing new concepts and methods. This paper aims to criticize and propose a new approach to citation analysis.
 Data Collection Method. A contemporary critical theory methodology was adopted as a framework to collect and analyze the data. Scientific publications related to citation analysis was collected from several databases such as Google scholar, Microsoft academic search, dan Garuda Ristekdikti. 
 Analysis Data. Publications data were critically reviewed and analyzed narratively by using open coding.
 Results and Discussions. The results mapped the lack of citation analysis form various aspects: (1) criticism of the positivist paradigm which did not succeed in achieving its objectives, (2) criticism of methods that produce invalid results, and (3) criticism of ethical issues of the researcher and bias in implementation. The proposed solution and recommendation is to change the citation analysis method from a simple measurement of bibliographic data to text and context analysis based on a computer science approach (machine learning techniques).
 Conclusion. This new method has the potential to be developed within the framework of quantitative in Science and Technology studies to overcome existing criticisms. Subsequent multidisciplinary studies are needed to lay a strong philosophical and technical foundation particularly in applying the in-text citation analysis method for evaluating research performance in accordance with the Indonesian context.

Development of Evaluation System for Iranian Health Research Networks: Challenges and Lessons Learned

Health research networks (HRNs) are critical components of large-scale systems of production and validation of scientific evidence. As evaluation of research systems is a reliable process to measure efficiency and effectiveness of their activities, we aimed to report the processes of development of evaluation indicators' for Iranian health research networks and the results of conducted assessment. In 2017, for the first time, aim to develop the evaluation framework for national HRNs, following the qualitative approach to assess the quality of research we designed the peer review method as one of the most important tools. This qualitative method was conducted according to experts' views in specific fields. Key policy makers and stakeholders collaboratively developed a number of criteria for evaluation of research performance of Iranian HRNs. Following the review of conducted studies, benefitting from published guide line, these indicators were defined under 4 main axes of governance and leadership; infrastructures; research products and research impact. Based on requirements of developed protocol for evaluation of HRNs in Iran, 18 HRNs completed the processes of evaluation. Results show a progressive need for more attention to precise planning of HRNs for achieving to goals. Another point to consider is the attention to documenting processes. The observational system for researches for detection of latest research priority was the most important issues that need to be more addressed by all of networks. Research evaluation of Iranian HRNs more over creating of constructive positive competition provide an overview of the shortcomings and research challenges could be used for better planning and promotion of the health research system.

Exploring the personal and professional factors associated with student evaluations of tenure-track faculty.

Tenure-track faculty members in the United States are evaluated on their performance in both research and teaching. In spite of accusations of bias and invalidity, student evaluations of teaching have dominated teaching evaluation at U.S. universities. However, studies on the topic have tended to be limited to particular institutional and disciplinary contexts. Moreover, in spite of the idealistic assumption that research and teaching are mutually beneficial, few studies have examined the link between research performance and student evaluations of teaching. In this study, we conduct a large scale exploratory analysis of the factors associated with student evaluations of teachers, controlling for heterogeneous institutional and disciplinary contexts. We source public student evaluations of teaching from RateMyProfessor.com and information regarding career and contemporary research performance indicators from the company Academic Analytics. The factors most associated with higher student ratings were the attractiveness of the faculty and the student’s interest in the class; the factors most associated with lower student ratings were course difficulty and whether student comments mentioned an accent or a teaching assistant. Moreover, faculty tended to be rated more highly when they were young, male, White, in the Humanities, and held a rank of full professor. We observed little to no evidence of any relationship, positive or negative, between student evaluations of teaching and research performance. These results shed light on what factors relate to student evaluations of teaching across diverse contexts and contribute to the continuing discussion teaching evaluation and faculty assessment.

Research progress in integrated thermal management of electric vehicles

Severe energy crisis and environmental pollution are the foremost problems in the world today. Electric vehicles have several advantages over traditional internal combustion engine-based vehicles, such as high energy efficiency and low emissions, which are effective in alleviating the energy crisis and environmental problems. However, the electric vehicles’ performance is greatly affected by temperature. An excessively high temperature during the charging and discharging process may accelerate the degradation rate of a battery cell and shorten its lifespan. In contrast, an excessively low temperature may reduce the battery’s efficiency and affect its discharge capacity. Air-conditioning systems in electric vehicles consume electricity to create a comfortable environment in the passenger compartment. However, excessive temperature of the motor drive will decrease its efficiency. Therefore, the battery, passenger compartment and motor drive system must be maintained at adequate temperatures to ensure the safety, comfort, and economy of the electric vehicles. Previous studies usually focused on a single thermal management system at a time, such as a battery thermal management system, air-conditioning systems in electric vehicles, and motor thermal management system. This means that the coupling relationships between the above-mentioned thermal management systems and the performance analysis of the integrated thermal management system at the vehicle level were not properly investigated. This study focused on the key issues in the construction of an integrated thermal management system for electric vehicles. Firstly, the heat generation models of the battery, passenger compartment, and motor drive system were summarized. Secondly, the existing thermal management methods for these three systems were systematically reviewed. Especially, the research status, operation control, and performance evaluation of the integrated thermal management system were especially analyzed. Finally, the deficiencies of the previous studies were summarized and the research prospects were proposed. It is pointed out that it is necessary to study the accurate heat generation models, develop the compact and efficient integrated thermal management system, and optimize the operation control of the integrated thermal management system under a comprehensive performance evaluation system in the near future.

Global tuberculosis research and its future prospects

Tuberculosis is the infectious disease that causes the most deaths each year in the world. Around 25% of the population is estimated to be infected with, Mycobacterium tuberculosis, the bacteria that gives rise to the disease, and more than one and a half million people die each year from this cause. A rigorous bibliometric analysis has been developed around tuberculosis disease, and the most remarkable results are presented in this paper. It is observed that interest in tuberculosis is growing, and the control of its spread has become one of the main health priorities in the world, with the United States, the United Kingdom, and India, leading the research in this area. On the other hand, it has been observed that there are two main health concerns around the tuberculosis: drug-resistant tuberculosis and co-infection with HIV. Finally, conclusions are offered, playing a frontline role in science policy decisions and research performance evaluations.

Exploring the limitations of the h-index and h-type indexes in measuring the research performance of authors

With the introduction of an increasing number of evaluation indexes, researchers have begun to pay attention to the limitations of such indexes in research evaluation, understanding which to avoid misusing and making evaluation more scientific and reasonable. Analysing the principles of the h-index, g-index, AR-index, p-index, integrated impact indicator (I3), and academic trace, this paper explores their limitations in measuring the research performance of authors from the perspectives of consistency, the degree of discrimination, and the statistical relationship between the values of indicators and the number of publications and citations. There are some interesting findings. These six indicators are highly consistent, and they are all more susceptible to the number of publications than to the frequency of citations. Among them, the h-index has the lowest degree of discrimination, followed by the g-index, I3, AR-index, p-index, and academic trace. The g-index ignores papers and citations other than the g-core. Moreover, compared to the h-index, the accumulation of citations makes it easier for the g-index to be equal to the number of papers published by an author, and once its value equals the number of papers, subsequent citations received by these papers will no longer contribute to the growth of the g-index unless the author publishes a new paper. Additionally, the AR-index ignores the h-tail papers and citations, which underestimates the impact of many researchers. Moreover, the p-index is insensitive to highly cited papers. Furthermore, the I3 is very vulnerable to the influence of the extremums in a data set. Finally, we propose considerations and suggestions for the research performance evaluation of authors.