Addressing drop-out and sustained effort issues with large practical groups using an automated delivery and assessment system

Abstract

The acquisition of programming skills specially in introductory programming courses poses an important challenge for freshmen students of engineering programs. These courses require students to devote a sustained effort during the whole course and a failure to do so may contribute to not passing the course. However, it is difficult for the teaching staff to deploy measures to enforce a pattern of continuous work without significantly increasing the required management tasks. A significant reduction of this workload can be achieved with the automation of time consuming tasks such as the delivery of activities or submission grading. This paper presents a case of study where a technology based orchestration of learning scripts was applied in a large enrollment course to promote student sustained effort through the course and keep the workload on teaching staff within reasonable margins. The orchestration system, based on IMS Learning Design and Generic Service Integration, automatically evaluated the student submissions and gradually unlocked the following activities depending on the received results. Such system was used during a semester supporting 425 students and 8 instructors. The analysis of the case of study followed a mixed method based on qualitative and quantitative data, and revealed a significant reduction of the orchestration workload on the teaching staff, allowing the strategy of continuous work to be applied in a course with high enrollment. Additionally, the application of these techniques show statistically significant differences in the drop out rate with respect to previous editions of the course. ► High enrolment courses poses a high workload to the teaching staff. ► The effects of an orchestration system is evaluated with a case study. ► The experimental setting was formed by 425 students and 8 teachers. ► Studied parameters are workload, drop out, course results and engagement. ► A significant decrease in the attrition rate is shown, having students acceptance.