PurposePerformance management in public sector organizations is a growing phenomenon worldwide. Increasingly, questions are being raised as to its effectiveness in achieving the objective of improving the performance of public sector organizations. Research has shown that there seems to be questionable benefits and many barriers, challenges and problems with implementing performance management and measurement in the public sector environment. The purpose of this paper is to argue that this is due to the lack of focus on the process of managing the implementation of performance measurement. The author aims to review the relevant extant literature to support these assertions and to provide a conceptual framework that integrates these ideas.Design/methodology/approachThis paper reviews the extant literature on public sector performance management and measurement and develops a conceptual framework to explain how public sector performance measurement systems can be made more effective in light of the research evidence.FindingsThis paper suggests that three important factors need to be considered in the effective implementation of a performance measurement system in the public sector. They are managerial discretion, a learning and evaluative organizational culture and stakeholder involvement. These three factors are discussed and its impact on performance measurement is explored.Research limitations/implicationsA proposed integrative framework is presented that supports the assertion of the importance of these three factors in influencing how performance measurement can lead to improved performance in public sector organizations. Some potential environmental and institutional constraints are also discussed in implementing some of the suggestions proposed.Practical implicationsThe paper provides a model that explains three important facors that need to be considered in implementing an effective performance measurement system in public sector organizations and suggestions for how it can be implemented effectively.Originality/valueThe paper integrates and synthesizes the literature on public sector performance measurement into a comprehensive conceptual framework that explains more explicitly the factors that can influence the effectiveness of a performance measurement system in the public sector.