Science communication competence (SCC) is an important educational goal in the school science curricula of several countries. However, there is a lack of research about the structure and the assessment of SCC. This paper specifies the theoretical framework of SCC by a competence model. We developed a qualitative assessment method for SCC that is based on an expert–novice dialog: an older student (explainer, expert) explains a physics phenomenon to a younger peer (addressee, novice) in a controlled test setting. The explanations are video-recorded and analysed by qualitative content analysis. The method was applied in a study with 46 secondary school students as explainers. Our aims were (a) to evaluate whether our model covers the relevant features of SCC, (b) to validate the assessment method and (c) to find characteristics of addressee-adequate explanations. A performance index was calculated to quantify the explainers’ levels of competence on an ordinal scale. We present qualitative and quantitative evidence that the index is adequate for assessment purposes. It correlates with results from a written SCC test and a perspective taking test (convergent validity). Addressee-adequate explanations can be characterized by use of graphical representations and deliberate switches between scientific and everyday language.