Performance Measurement Research Research Articles

Analysis Of Ship Main Engine Procurement Process In The Shipyard Industry Using Supply Chain Operation Reference Method (SCOR) (Case Study: PT XYZ)

As a sector playing a crucial role in ship construction and repair, the shipbuilding industry faces significant challenges in material procurement, where materials constitute 50-70% of the total project cost. One of the materials requiring paramount attention is the ship's main engine. Effective supply chain management is critical to enhancing efficiency and effectiveness in the procurement process of ship engines. However, supply chain performance measurement research, especially in ship engine procurement, still needs to be improved. Therefore, this study aims to identify relevant performance metrics, analyze critical performance indicators, and provide recommendations based on the SCOR (Supply et al.) framework to improve ship engine procurement. The research results present 24 metrics distributed into four performance attributes based on SCOR 12.0, with 22 selected metrics aligned with the company's context. Analysis using the AHP method indicates that the reliability attribute has the highest weight (0.296), with the metric "Percentage of procurement received on time as per request" being the top priority (weight 0.143). This study provides a holistic view of crucial aspects of the ship engine procurement supply chain, supporting companies in enhancing their performance in the procurement process.

Sustainability performance efficiency in the banking sector

Traditional sustainability reporting is based on an internally developed methodology and does not fully cope with the sustainability performance evaluation, especially from an external perspective. This study aims to fill this gap by offering a tool that may be used to assess the company’s performance based on the results presented to external users. For this purpose, a two-stage data envelopment analysis (DEA) is proposed, that enables a comparison of the sustainability performance disclosed in non-financial reports in the banking industry in Poland, Croatia, and Romania. The findings of our study identify differences between the efficiency of sustainability performance in the banking sectors of all three countries. The proposed approach to compare hard-to-compare sustainability performance may significantly contribute to the decision-making process for stakeholders and, therefore, to the advancement of sustainability performance measurement research.

Evolution of Performance Measurement Research: An Update on Research Development from 2005 to 2020 and Future Outlook for the Field

Evolution of Performance Measurement Research: An Update on Research Development from 2005 to 2020 and Future Outlook for the Field

Expanding public sector performance measurement and management research with actor-centred approaches in new institutionalism

PurposeIn his 2022 paper, in the Journal of Public Budgeting, Accounting and Financial Management, Sven Modell reviews and reflects on the public sector's institutional research dealing with performance measurement and management (PMM) over the past decade. Modell suggests potential extensions of this body of research. This paper seeks to contribute to the path that Modell initiated. It offers directions in which institutional theory might contribute further to research on agentic aspects of PMM in the public sector.Design/methodology/approachThe paper is a rejoinder emphasizing how institutional theory could further nurture reflection on PMM research in the public sector. The authors draw upon Modell's article and ongoing research in the institutional theory field.FindingsModell insists that institutional research on PMM in the public sector should explore the constitutive effects of PMM practices while conceiving such practices as institutionally embedded phenomena. The authors seek to extend this approach by considering the role of agency in institutional processes. To do this, the authors build on recent institutional research on agency, discussing how those new conceptualizations could nurture and develop the understanding of PMM practices in the public sector. The authors further discuss implications for coupling and decoupling as sites of agency. Such literature is relevant for examining emerging themes in public-sector accounting because it allows the authors to better conceptualize the underlying mechanisms of agency in the context of public service provision characterized by institutional complexity.Originality/valueThis paper details several implications of the current developments in new institutional theory in examining agency in the relationship between institutions and PMM, pointing at the case of decoupling. In so doing, the authors seek to stimulate a constructive exchange between public-sector accounting and a broader institutionalist body of research and suggest ways of extending the PMM research agenda.

How reliable are unsupervised author disambiguation algorithms in the assessment of research organization performance?

Abstract Assessing the performance of universities by output to input indicators requires knowledge of the individual researchers working within them. Although in Italy the Ministry of University and Research updates a database of university professors, in all those countries where such databases are not available, measuring research performance is a formidable task. One possibility is to trace the research personnel of institutions indirectly through their publications, using bibliographic repertories together with author names disambiguation algorithms. This work evaluates the goodness-of-fit of the Caron and van Eck, CvE unsupervised algorithm by comparing the research performance of Italian universities resulting from its application for the derivation of the universities’ research staff, with that resulting from the supervised algorithm of D’Angelo, Giuffrida, and Abramo (2011), which avails of input data. Results show that the CvE algorithm overestimates the size of the research staff of organizations by 56%. Nonetheless, the performance scores and ranks recorded in the two compared modes show a significant and high correlation. Still, nine out of 69 universities show rank deviations of two quartiles. Measuring the extent of distortions inherent in any evaluation exercises using unsupervised algorithms, can inform policymakers’ decisions on building national research staff databases, instead of settling for the unsupervised approaches.

Measuring network-driven citations: An adjusted citation count metric

Citation count is extensively used within research systems to measure research performance and relevance. However, high numbers of citations could result from many different factors. This paper proposes an adjusted citation count metric to help identify citations from researchers’ networks. Using data from the Web of Science core collection, this research suggests and illustrates an approach to compute the proportion of citation counts from within and out of author networks, defined as the set of their co-authors. The results reveal the trends and effects of author networks on citation counts. The paper explains how these findings could be used to assess research performance. Its utilisation will depend mainly on the objectives of the assessor and the stage of the researcher’s career. An algorithm is also proposed that could be used to automate the computation of the proposed metric. It could serve as a step towards refining and integrating this metric into existing bibliometric analysis packages built on the R software platform.

Project performance measurement for small-and-medium sized construction contractors in the Jordanian construction industry

This article addresses a gap in construction project performance measurement research from the perspective of small-medium-sized construction contractors in developing countries. Focussing on small-medium-sized contractors in the Jordanian construction industry, a survey of 231 Jordanian construction professionals was undertaken to investigate how different project stakeholders, intra and extra-organisational relationships and financial and non-financial measures support or hinder the delivery of project outcomes. Using exploratory factor analysis (EFA), confirmatory factor analysis (CFA) and Partial Least Squares Structural Equation Modelling (PLS-SEM) an integrated theoretical performance measurement model was developed and tested which contributes to the advancement of construction project performance measurement research in a number of ways. First, it shows that small-medium-sized contractor project performance is a multi-dimensional, dynamic and contested construct which is bounded by environmental and organisational constraints, and inseparable from mainstream business performance. Second, it shows that performance is measured by six project-related constructs (project cost, time, quality, health and safety, environmental sustainability, and socio-economic performance) and three business-related constructs (profitability, client satisfaction and consultant satisfaction). Third, it shows that four intra-organisational groups of variables (leadership, management capabilities, human resource management and technical capabilities, resources and processes) have a significant impact on the overall project and business performance. Fourth, it shows that four extra-organisational groups of variables (client performance, consultant performance, supplier performance and external attributes) have a significant direct impact on project performance, but no moderating impact was found.

“What is going on in the ‘big tent’?” Current developments in (new) institutional theory and performance measurement and management research

PurposeIn a recent paper that was published in Journal of Public Budgeting, Accounting and Financial Management, Modell (2021) takes stock of the institutional research on performance measurement and management (PMM) in the public sector and proposes a number of avenues for further inquiry in the area. The aim of this comment is to contextualise some of his observations against the backdrop of current developments in (new) institutional theory.Design/methodology/approachThe recent scholarly debate about whether institutional theory needs any redirecting is the point of departure for this comment. Three of the themes from this debate are revisited and implications for research on PMM in the public sector are outlined.FindingsFirst, against the backdrop of an emerging plethora of organisational forms in the public sector, this comment focusses on the locus or “where” PMM can be analysed and how organisational forms affect PMM. The second point addresses the “what” of analysis, where it is argued that PMM instruments are embedded in an ecology of concepts and a relational perspective on diffusion is introduced. A third observation is related to methodological issues and discusses the “how”: how best to study manifestations of PMM systems.Originality/valueThe comment illustrates a number of implications of the current developments in (new) institutional theory for research on PMM. In so doing, the wider ambition is to stimulate an exchange between public-sector accounting and organisation studies.

Trends in small business performance measurement research: a review of 25 years literature

This research is possibly the first of its kind to present a thorough analysis of performance measurement approaches in small business researches. To make this study centred on small business, we selected the journals that are primarily meant for small businesses and have a high impact measured through their cite score. We picked up the primary research articles carrying performance in their title and measurement of overall performance. We then applied the content analysis technique to analyse the performance data. The analysis brought several crucial findings concerning the trends in publications, usage of different measures, choices of financial and non-financial measures, and aptness of the subjective and objective approach. Besides these, the study also laid out their implications and future directions.

Trends in small business performance measurement research: a review of 25 years literature

Trends in small business performance measurement research: a review of 25 years literature

Substantiality: A Construct Indicating Research Excellence to Measure University Research Performance

Abstract Purpose The adequacy of research performance of universities or research institutes have often been evaluated and understood in two axes: “quantity” (i.e. size or volume) and “quality” (i.e. what we define here as a measure of excellence that is considered theoretically independent of size or volume, such as clarity in diamond grading). The purpose of this article is, however, to introduce a third construct named “substantiality” (“ATSUMI” in Japanese) of research performance and to demonstrate its importance in evaluating/understanding research universities. Design/methodology/approach We take a two-step approach to demonstrate the effectiveness of the proposed construct by showing that (1) some characteristics of research universities are not well captured by the conventional constructs (“quantity” and “quality”)-based indicators, and (2) the “substantiality” indicators can capture them. Furthermore, by suggesting that “substantiality” indicators appear linked to the reputation that appeared in university reputation rankings by simple statistical analysis, we reveal additional benefits of the construct. Findings We propose a new construct named “substantiality” for measuring research performance. We show that indicators based on “substantiality” can capture important characteristics of research institutes. “Substantiality” indicators demonstrate their “predictive powers” on research reputation. Research limitations The concept of “substantiality” originated from IGO game; therefore the ease/difficulty of accepting the concept is culturally dependent. In other words, while it is easily accepted by people from Japan and other East Asian countries and regions, it might be difficult for researchers from other cultural regions to accept it. Practical implications There is no simple solution to the challenge of evaluating research universities’ research performance. It is vital to combine different types of indicators to understand the excellence of research institutes. Substantiality indicators could be part of such a combination of indicators. Originality/value The authors propose a new construct named substantiality for measuring research performance. They show that indicators based on this construct can capture the important characteristics of research institutes.

Counting what counts: A researcher productivity scoring framework for South African's universities of technology

One of the three objectives of academic institutions all over the world is that of ensuring and upholding vibrant research productivity. For developing countries such as South Africa, public spending on research and development provides mechanisms for this. The South Africa’s Department of Higher Education and Training (DHET) is the custodian of government research funds. Evidence shows that DHET continues to grapple with the challenge of objectively measuring research productivity from the research funds invested in universities. The current funding framework applied by DHET has received numerous criticism one of them being its quantitative nature - it rewards quantity as opposed to quality research. This problem is more pronounced in Universities of Technology (UoTs) where, after more than ten years of operating as universities, the culture of research is not yet fully entrenched. Acknowledging the critical role played by research productivity measurements, we present a research productivity and quality measurement framework for UoTs. Using a case study of one of the UoTs, quantitative data relating to 48 aspects of the of existing research incentive system was used in determining the system’s effectiveness and efficacy in stimulating researchers’ activities. The proposed Framework consists of three components on: how to motivate researchers, what/how to measure research performance and how to incentivise researchers. Using an actual dataset of research outputs from the case study, an illustration on how to apply the framework has been provided. The results confirm our Framework’s ability to “count what counts” and proven the statement that “not everything that can be counted counts”.

Measuring research performance of Iraqi universities using Scopus data

This study investigates the research performance of the Iraqi public and private universities using the Scopus citation database. The investigation consists of three stages. The first stage includes the registration of these universities in the database. The second represents the process of merging the multiple accounts of each university. The two stages have been completed within one year (from start to end of 2017), which result in a significant improvement in the research performance, in term of number of published articles (Pu), number of citations (C) and h index. Analysis of the improved h index obtained from the Scopus site, reveals a clear bias towards large universities, due to neglecting the number of researchers (NS) in calculating the h index. In the third stage, two new empirical equations are suggested for measuring research performance of universities. The first proposed equation predicts a modified h index as a function of Pu, C, and NS and implements to Iraqi universities and selected universities from other countries. The second proposed equation is a combination of three sub-indicators, namely: citations per article, articles per researcher, and percentage of non-cited articles. Discussion of results indicates that the developed equations eliminate the bias of the large universities over the small ones and highlight some useful recommendations for the universities to enhance their ranking in scientific performance.

МОДЕЛЬ СТИМУЛЮВАННЯ НАУКОВОГО ТА ВИКЛАДАЦЬКОГО СКЛАДУ В ЗВО УКРАЇНИ ШЛЯХОМ ВИКОРИСТАННЯ ІТ ПІД ЧАС ОБМІНУ ЗНАННЯМИ З МЕТОЮ ПОКРАЩЕННЯ РЕЗУЛЬТАТІВ НАУКОВИХ ПУБЛІКАЦІЙ

Research and development are central to national and civilizational achievements. Research and development in any country is measured by the results of research, such as scientific publications. Scientific publications become the main criterion for evaluating teachers, as well as research and teaching staff of higher education institutions and research institutions. Knowledge is the most important resource in universities. Useful knowledge can improve the performance of employees in the organization. The exchange of knowledge or information exchange between employees is important for scientists and practitioners. Acquisition of knowledge, exchange of knowledge and use of knowledge are three types of knowledge management. Higher education in Ukraine seeks to strengthen research as a key component of the development of the nation and its universities. In recent years, higher education in Ukraine has initiated many projects to improve research on the productivity of research and teaching staff in Ukrainian universities. Ukrainian higher education seeks to automate all research activities to increase the effectiveness of research. This article discusses the impact of knowledge use. Joint use to improve the scientific publications of scientists and teachers of Ukrainian universities. In addition, this study identifies factors that lead to an increase in the level of knowledge exchange in Ukrainian universities. The author conducted an online interview with 350 representatives of the scientific and pedagogical staff of the Taras Shevchenko National University of Kyiv, studied scientific articles and websites of academic institutions to determine important indicators for measuring the productivity of scientific research. The results show that computer- mediated communication and the nature of knowledge are the main factors that positively affect the exchange of knowledge in Ukrainian universities. The author also concluded that scientific publications are a key indicator for measuring research performance. In addition, the exchange of academic knowledge and indirect communication significantly increases the productivity of research in Ukrainian universities.

Scientometric assessment of research publications from fisheries institutes under Indian Council of Agricultural Research (ICAR) during 2009-2018

The national fisheries research in India is spearheaded by domain-specific fisheries research institutions under the aegis of the Indian Council of Agricultural Research (ICAR), New Delhi. The current study was undertaken to assess the temporal trends in research publications during the period 2009-2018, from eight fisheries research institutes under ICAR using ‘SciVal’, a web-based scientometric tool of Elsevier for measuring research performance. The data on various research metrics, such as the number of publications, their citations, field-weighted research impacts, number of publications in top journals, subject area categories and key phrases used in research outputs were extracted from the application. The assessment revealed that a total of 3263 papers were published by the fisheries research institutes under ICAR during the study period, which received 24,253 citations in total. The number of publications from the ICAR fisheries research institutes and their quality showed a steady increase over the years. The foremost journal for publishing Indian fisheries research outputs during the assessment period was the Indian Journal of Fisheries (408 papers; 12.5%) published by ICAR, New Delhi. The research focus of these institutes was found to be more towards the widely cultivated species, i.e., Penaeus (=Litopenaeus) vannamei and Pangasionodon hypophthalmus. The present study highlights the research areas with significant momentum and scope for future funding; provides insights on the research trends and necessary leads to prioritise research among the national fisheries research institutes under ICAR.

Analysis and Measurement of Scientific Collaboration Networks Performance

Collaboration of scientific research among researchers or universities is very important especially to improve the quality and quantity of the research. It gives the positive impact and very beneficial for both parties so this scientific research network becomes an important component in measuring performance and ranking institutions for national and international levels. The interviews result show that the amount of collaboration alone cannot fair to be used as performance measurement, because in general the successful collaboration can be established to other institutions with higher ranks, which will give a good quality impact to the institution. The purpose of this paper is to propose a new performance measurement formula using case studies in Indonesia. Scientific collaboration networks are generated based on data from lecturers and institutions, especially research outputs indexed in the SINTA-Science and Technological Index. SINTA is the largest and most comprehensive portal for measuring research performance in Indonesia. The formula proposed in this research is to consider the number and weighting based on the score of the institution in the previous year to calculate a new score of the performance of the scientific collaboration network. Implementation results show that Riau Province has the highest collaboration score at the regional level, while the Bandung Institute of Technology as an institution with a score of 46.563 is the highest at the institutional level

Analysis and Measurement of Scientific Collaboration Networks Performance

Collaboration of scientific research among researchers or universities is very important especially to improve the quality and quantity of the research. It gives the positive impact and very beneficial for both parties so this scientific research network becomes an important component in measuring performance and ranking institutions for national and international levels. The interviews result show that the amount of collaboration alone cannot fair to be used as performance measurement, because in general the successful collaboration can be established to other institutions with higher ranks, which will give a good quality impact to the institution. The purpose of this paper is to propose a new performance measurement formula using case studies in Indonesia. Scientific collaboration networks are generated based on data from lecturers and institutions, especially research outputs indexed in the SINTA-Science and Technological Index. SINTA is the largest and most comprehensive portal for measuring research performance in Indonesia. The formula proposed in this research is to consider the number and weighting based on the score of the institution in the previous year to calculate a new score of the performance of the scientific collaboration network. Implementation results show that Riau Province has the highest collaboration score at the regional level, while the Bandung Institute of Technology as an institution with a score of 46.563 is the highest at the institutional level

System dynamics applications in performance measurement research: progress and challenges

PurposeA systematic literature review (SLR) was used to identify and analyze literature related to use of system dynamics (SD) applications in organizational performance measurement (PM) research. The purpose of this article is to present the results of a thematic analysis (TA) conducted to synthesize existing empirical evidence, investigate trends and evaluate developments in the research area.Design/methodology/approachA SLR was conducted resulting in a dataset of 97 articles in this research area. Using TA, major themes/subthemes were inductively synthesized to explore the current development and emerging trends and provide guidance for future research.FindingsThe TA resulted in seven themes in the research area – Enhancing knowledge, Approaches to operationalizing PM systems, Utilizing simulation models, Improving organizational outcomes, Achieving strategic alignment, Applying systems thinking and Identifying critical variables. The analysis suggests that although SD has the potential to improve PM systems, there are many limitations and challenges that must be addressed to improve implementation and practical applications. In addition, the results showed that much of the work is exploratory and many fail to fully validate their models suggesting that this research is still in an relatively early phase of development.Research limitations/implicationsThe results of this study are limited to the 97 articles identified using the SLR protocol. Although the search was designed to be comprehensive, there may be other relevant literature that was excluded. Further, the TA was limited to addressing the research questions.Practical implicationsA key insight for managers is that these tools would support decision-makers in understanding performance behaviors and identifying performance drivers for improvement. This suggests that stakeholders can adopt the approach to improve understanding and effectiveness of PM, and to enhance strategic decision-making.Originality/valueThis study provides a distinct and thorough analysis of this research area by conducting an inductive synthesis of developments and challenges and guidance for future research and practice. The resulting thematic model, identified code definitions and proposed framework of strategies to overcome challenges, provide a general overview and resource to support future studies in the research area and facilitate practical use of SD capabilities to support PM.

Google Scholar and other systems for indexing scientometric indicators used by belarusian universities

Aim . To compare the effectiveness of evaluating the publication activity of organizations and authors by such indexing systems as Google Scholar, Scopus and RINTS, as well as to assess the reliability and credibility of these indexing systems in terms of measuring research performance. On the basis of this information, the reliability of the systems currently used to rank Belarusian universities, in particular the University of Grodno, was estimated. Methods . This article analyses and compares the effectiveness of various indexing systems, which is extremely relevant due to the widespread use of the Google Scholar, Scopus, and RINTS indexing systems in Belarus. Results . The general characteristics of the above-mentioned indexing systems and their significance in assessing the research performance of university staff are given. A comparative assessment of the indexing systems was carried out, including their specific features, advantages and disadvantages. The conducted analysis of the ideology and mechanism of indexing research data using Google Scholar proved the unreliability and inconsistency of this approach for evaluating research performance, as well as the fallacy of adopting this system for evaluating the publication activity of university staff. Conclusion . The analysis of the Russian Science Citation Index (RINTS) also revealed significant imperfections. However, the use of RINTS does provide a fairly objective comprehensive assessment of the publication activity of authors and organizations. In addition, RINTS enables an analysis of the structure of indicators, which is completely impossible using Google Scholar and Scopus.

Big data and performance measurement research: trends, evolution and future opportunities

PurposeCurrent literature recognised big data as a digital revolution affecting all organisational processes. To obtain a competitive advantage from the use of big data, an efficient integration in a performance measurement system (PMS) is needed, but it is still a “great challenge” in performance measurement research. This paper aims to review the big data and performance measurement studies to identify the publications’ trends and future research opportunities.Design/methodology/approachThe authors reviewed 873 documents on big data and performance carrying out an extensive bibliometric analysis using two main techniques, i.e. performance analysis and science mapping.FindingsResults point to a significant increase in the number of publications on big data and performance, highlighting a shortage of studies on business, management and accounting areas, and on how big data can improve performance measurement. Future research opportunities are identified. They regard the development of further research to explain how performance measurement field can effectively integrate big data into a PMS and describe the main themes related to big data in performance measurement literature.Originality/valueThis paper gives a holistic view of big data and performance measurement research through the inclusion of numerous contributions on different research streams. It also encourages further study for developing concrete tools.