Developing a team-based assessment strategy: direct observation of interprofessional team performance in an ambulatory teaching practice

Abstract

Background: High functioning interprofessional teams may benefit from understanding how well (or not so well) a team is functioning and how teamwork can be improved. A team-based assessment can provide team insight into performance and areas for improvement. Though individual assessment via direct observation is common, few residency programs in the United States have implemented strategies for interprofessional team (IPT) assessments. Methods: We piloted a program evaluation via direct observation for a team-based assessment of an IPT within one Internal Medicine residency program. Our teams included learners from medicine, pharmacy, physician assistant and psychology graduate programs. To assess team performance in a systematic manner, we used a Modified McMaster-Ottawa tool to observe three types of IPT encounters: huddles, patient interactions and precepting discussions with faculty. The tool allowed us to capture team behaviors across various competencies: roles/responsibilities, communication with patient/family, and conflict resolution. We adapted the tool to include qualitative data for field notes by trained observers that added context to our ratings. Results: We observed 222 encounters over four months. Our results support that the team performed well in measures that have been iteratively and intentionally enhanced – role clarification and conflict resolution. However, we observed a lack of consistent incorporation of patient-family preferences into IPT discussions. Our qualitative results show that team collaboration is fostered when we look for opportunities to engage interprofessional learners. Conclusions: Our observations clarify the behaviors and processes that other IPTs can apply to improve collaboration and education. As a pilot, this study helps to inform training programs of the need to develop measures for, not just individual assessment, but also IPT assessment.