Observer Ratings Of Performance Research Articles

A comprehensive method to design and assess mixed reality simulations

The scientific literature highlights how Mixed Reality (MR) simulations allow obtaining several benefits in healthcare education. Simulation-based training, boosted by MR, offers an exciting and immersive learning experience that helps health professionals to acquire knowledge and skills, without exposing patients to unnecessary risks. High engagement, informational overload, and unfamiliarity with virtual elements could expose students to cognitive overload and acute stress. The implementation of effective simulation design strategies able to preserve the psychological safety of learners and the investigation of the impacts and effects of simulations are two open challenges to be faced. In this context, the present study proposes a method to design a medical simulation and evaluate its effectiveness, with the final aim to achieve the learning outcomes and do not compromise the students' psychological safety. The method has been applied in the design and development of an MR application to simulate the rachicentesis procedure for diagnostic purposes in adults. The MR application has been tested by involving twenty students of the 6th year of Medicine and Surgery of Università Politecnica delle Marche. Multiple measurement techniques such as self-report, physiological indices, and observer ratings of performance, cognitive and emotional states of learners have been implemented to improve the rigour of the study. Also, a user-experience analysis has been accomplished to discriminate between two different devices: Vox Gear Plus® and Microsoft Hololens®. To compare the results with a reference, students performed the simulation also without using the MR application. The use of MR resulted in increased stress measured by physiological parameters without a high increase in perceived workload. It satisfies the objective to enhance the realism of the simulation without generating cognitive overload, which favours productive learning. The user experience (UX) has found greater benefits in involvement, immersion, and realism; however, it has emphasized the technological limitations of devices such as obstruction, loss of depth (Vox Gear Plus), and narrow FOV (Microsoft Hololens).

Improving interprofessional competence in undergraduate students using a novel blended learning approach

Interprofessional simulation interventions, especially when face-to-face, involve considerable resources and require that all participants convene in a single location at a specific time. Scheduling multiple people across different programs is an important barrier to implementing interprofessional education interventions. This study explored a novel way to overcome the challenges associated with scheduling interprofessional learning experiences through the use of simulations in a virtual environment (Web.Alive™) where learners interact as avatars. In this study, 60 recent graduates from nursing, paramedic, police, and child and youth service programs participated in a 2-day workshop designed to improve interprofessional competencies through a blend of learning environments that included virtual face-to-face experiences, traditional face-to-face experiences and online experiences. Changes in learners' interprofessional competence were assessed through three outcomes: change in interprofessional attitudes pre- to post-workshop, self-perceived changes in interprofessional competence and observer ratings of performance across three clinical simulations. Results from the study indicate that from baseline to post-intervention, there was significant improvement in learners' interprofessional competence across all outcomes, and that the blended learning environment provided an acceptable way to develop these competencies.

Kernels of truth or distorted perceptions: Self and observer ratings of social anxiety and performance

This study compared self and observer ratings of social performance and anxiety among individuals with social anxiety disorder, nonclinical controls, and participants with dysthymia serving as clinical controls. The purpose was to elucidate whether self-perceptions of individuals with social anxiety disorder reflect observable performance and anxiety differences, negative self-perceptions, or an interaction of the two. Participants engaged in three role-played interactions, and self and observer ratings of performance and anxiety were obtained. In general, self-ratings of anxiety and performance were more negative (greater anxiety and poorer performance) than were observer ratings. Interactions of rating source and diagnosis indicated the discrepancy between self and observer ratings of both anxiety and performance was significantly greater among participants with social anxiety disorder. Observers, however, generally noted differences across the groups in both anxiety and performance. The discrepancies between self and observer ratings of anxiety were related to negative evaluation fears and negative thought patterns, while performance discrepancies were related to negative thought patterns. Treatment implications are discussed.

Discrepancy between self- and observer ratings of performance in social phobics.

Discrepancy between self- and observer ratings of performance in social phobics.

Discrepancy between self- and observer ratings of performance in social phobics.

Twenty-eight subjects meeting Diagnostic and Statistical Manual of Mental Disorders (rev. 3rd ed.; American Psychiatric Association, 1987) criteria for social phobia and without a comorbid affective disorder and 33 nonclinical controls were asked to present a brief, impromptu speech to a small audience. Speakers themselves, as well as members of the audience, rated each speaker on a public speaking questionnaire that included both specific items (e.g., voice shook) and global items (e.g., appeared confident). For global items, no significant difference was indicated between the two groups on observers' ratings of public speaking performance. However, social phobics rated their own performance worse than did nonclinical controls, and there was a significantly greater discrepancy between self and other ratings for social phobics than controls. Fear of negative evaluation was the only significant predictor of the self-other discrepancy on global items.