A flexible multicriteria decision-making methodology to support the strategic management of Science, Technology and Innovation research funding programs

Abstract

Research funding programs are a policy instrument utilized by governments to influence the innovation process. They are usually elaborated, launched and managed by research funding agencies. In order to select the most adequate research projects, agencies often rely on the peer review process.This paper introduces a methodology to support funding decisions based on the peer review process. The methodology involves the use of a multicriteria decision model to support the assessment, evaluation, prioritization and selection of applications, under a multi-step decision-making process, which fits into a strategic management cycle within the agency. The Multiattribute Value Theory, being considered under a Value Focused Thinking approach, provides a basis for the construction of the multicriteria decision model. The good practices in peer review and also a logical framework for program management are considered by the methodology.A pilot study, presented in the paper, involved a retrospective implementation of a peer review process in the context of a program launched by the Ministry for Science, Technology, Innovations and Communications and the National Council of Technological and Scientific Development, in Brazil. The methodology allowed a clear distinction of roles. The agency staff in the role of decision-makers was responsible for making value judgments on behalf of the agency. The experts, in the role of committee members and ad hoc reviewers, contributed with their expertise by providing objective assessments. Such assessments served as a basis for evaluating the applications, characterizing the possible portfolios, and can be considered as data in future program evaluation studies.