Background/ObjectivesNew teaching methods are warranted to meet the demand for increased flexibility in medical education while making optimal use of the limited resources of educators. The COVID-19 pandemic forced universities to resort to online-only teaching, even for training of psychomotor skills. The objectives of this study were: (I) to investigate the performance of students without previous experience in ear, nose and throat (ENT) examination after completing an asynchronous online teaching course in an objective standardized clinical examination (OSCE) and (II) to evaluate the degree of over- and underestimation of their abilities. MethodsThe study was designed as a prospective, single-institution medical education cohort study. Medical students (n = 54; 3rd/4th year, no previous head and neck examination skills) completed a comprehensive online training for basic head and neck examination skills 1–14 days before undergoing an OSCE on 5 different examination items (cervical lymph node examination, oral/oropharyngeal examination, otoscopy, Weber/Rinne hearing test, anterior rhinoscopy). Expert-evaluated theoretical knowledge and practical abilities were measured using Likert scales (1 = high proficiency to 5 = low proficiency). Participants self-evaluated their own skills before and after the OSCE (5-point Likert scales). ResultsStudents achieved an overall good to medium skill level in basic head and neck examination after online training. Increased psychomotor complexity of tasks contributed to worse performance. Expert evaluation of practical skills was better in male participants and those who rated their preparation as thorough. Low/no misjudgment (discrepancy between self- and expert-evaluation) was observed in most participants, while high discrepancy levels (strong misjudgment) were mainly attributable to the students’ underestimation of their own abilities. ConclusionsOnline training of head and neck examination skills is a cost- and resource-efficient introduction to skill training and was inevitable during the pandemic. However, it cannot replace practical hands-on training, especially in tasks with high psychomotor requirements. Refresher-courses could compensate for cancelled skill training during the pandemic.