The Methodology of Rating Methodologies: The Problem of Constructing Correct University Ratings

Abstract

The article is devoted to the substantiation of the general (framework) methodology for creating correct methodologies of university ranking, which capable of correctly (truly, in accordance with reality) ranking universities, primarily top ones. The conceptual foundations of such a methodology are formulated. It is based on a mission-based approach to the definition of university and ranking excellence, which involves the determination of the criterion-indicator base of the ranking both by its mission and by the mission of the university, especially a globally leading institution. Essential definitions of relevant missions as key system-creating factors are given. A criterion for the formulation of the true mission is proposed. The principle of mission minimisation of the list of necessary and sufficient ranking criteria / indicators and the principle of their mission synergy for the unambiguous orientation of university development are substantiated. The general methodology prevents the de-specification of the ranking and university missions, the dissynergisation of ranking criteria and indicators, their divergence and fragmentation, and the disorienting action. This methodology covers methodologies both simple (mono) and complex (combined), as well as general (institutional) and sectoral (by academic subjects) rankings. The methodology built on these foundations will contribute to the adoption of rankings as objective and reliable evaluation tools, the effective use of the IREG Berlin principles for the creation of ranking methodologies, the acceleration of the formation of a university ranking culture and its legislative regulation in Ukraine, and the further development of science about universities. This is important for the development of a strategy for the formation of leading universities of the highest excellence (strategy-2), the implementation of the second dimension of the European higher education area in terms of achieving its competitiveness and attractiveness, the approaching victory of Ukraine in the war, the innovative recovery of the country, the establishment of Ukraine as a strong European integrated state.