The evaluation of research performance in psychiatry. Potential and pitfalls of bibliometric analysis

Abstract

Recent scientific and economic developments have emphasized the need for objective and operationalized criteria for the evaluation of collective and individual research performance. In this context the present article discusses the possibilities and limitations of bibliometric analysis in the evaluation of psychiatric research. Taking into account recent scientometric knowledge, the potentials and pitfalls of the so called impact factor are critically discussed with respect to its usefulness in the evaluation of psychiatric research performance in Germany. A major criticism arises from the observation that the unreflecting use of the impact factor may overemphasize quantitative aspects to the disadvantage of qualitative aspects of research. This may however lead to unwanted distortions and misjudgements. The critical analysis of the current use of scientometric indices in the evaluation process emphasizes the need for alternative criteria, which should take into account disciplinary as well as national idiosyncrasis. Accordingly, the authors aim to induce and contribute to a discussion process within the scientific community, which may lead to a more appropriate evaluation of psychiatric research performance.