Numerical Ratings and Content Labeling of Speeches in an Educational Public Speaking Program

Abstract

<p style="text-align: justify;">Education in public speaking often relies largely on qualitative feedback. In this study, we explored how a numerical feedback form based on a validated scale could be used in an educational public speaking program. Data were collected at three clubs of Toastmasters International. Speech content was labeled to enable statistical analysis of correlations between speech content and audience ratings. 216 speeches by 59 speakers were evaluated by audience members, providing 1416 individual evaluations. All rating categories correlated strongly with each other. Speeches mentioning relationships, personal stories and positive emotions were rated more favorably. Speeches given in-person were rated more highly in several dimensions compared to speeches given through online video. There were some sex differences in choice of content and emotional expressiveness, but not in audience ratings of speech quality. Overall, the study found that the method was useful for both providing individual feedback and aggregated data for research purposes.</p>