Using Multiple Methods in Assessing Oral Communication Skills in the Final Year Project Design Course of an Undergraduate Engineering Program

Abstract

Engineering education researcher Rogers (2006) proposed that an assessment of engineering programs should use a multi-method approach to maximize validity and reduce the biasness of any one approach. Based on this reason, this study used two methods in the direct assessment of oral communication skills performance outcome of an undergraduate electrical engineering students’ Final Year Project (FYP) design experience. In the first method, the Oral Communication Assessment Rubrics adapted from Norback et al. (2008) was tested for its reliability, consistency in the scores and ease of use. This was to ensure that the results were descriptive of the expected students’ performance (Miller & Olds, 1999). Once faculty rater reliability was achieved and verified, the rubrics were refined and redrafted to obtain inter-rater scores for the assessment of the oral communication skills during the FYPII seminar presentation. Descriptive statistics were used to draw inferences from the inter-rater scores. In the second method, the researcher used the final grades of these students which were obtained from the faculty end-of-course assessment of their FYPII seminar presentation through the use of the faculty Seminar Evaluation Form (SEF). The scores obtained from SEF were reported in the Course Assessment Summary Report (CASR) in the form of the achieved Key Performance Indicator (KPI) of the students in each department in the Electrical Engineering Faculty (FKE).