PurposeThe purpose of this paper is to investigate a set of competencies that characterizes effective public middle managers.Design/methodology/approachA total of 20 middle managers from several public agencies were interviewed in person using the behavioral event interview technique. In all, 80 stories were deductively coded based on the existing National Civil Service Agency’s managerial competency dictionary and inductively examined through a thematic analysis to discover new themes.FindingsThis study’s findings suggest that communication, organizing, information seeking, analytical thinking and planning competencies are common competencies, but essential for effective public middle managers. Conversely, achievement orientation, leadership, directiveness, persuasiveness and innovation are competencies that characterize effective public middle managers and distinguish them from average performers. In addition, some other new competencies inductively obtained using a thematic analysis are also important for effective public managers: adherence to laws and regulations, multi-stakeholder collaboration, and technical competencies (technology management, human resource management and financial management).Research limitations/implicationsThe research was undertaken using 20 samples divided into superior and average performers; thus, it is limited to developing competency levels to new competencies.Originality/valueThis study identifies the competencies necessary for effective middle managers within the public sector context. Conducting behavioral event interviews with two distinct groups provides empirically unique behavioral evidence of competencies that characterize effective public middle managers and enables to discover new competencies.