Abstract
Objective. To evaluate a telehealth simulation rubric for a pharmacy skills lab course using interrater reliability (IRR) to compare different evaluator types.Methods. A rubric was developed and used to score student pharmacists' competency in a telehealth simulation for a pharmacy skills lab course. Intraclass correlation coefficients (ICCs) were calculated to determine the IRR.Results. Fifty-five recorded telehealth simulation sessions were scored three times by a pool of evaluators using the rubric. The overall ICC for the rubric was 0.631 across different types of evaluators, indicating good IRR. Differences in ICCs were observed when they were calculated for type of evaluator and rubric subcomponents.Conclusion. The rubric demonstrated good IRR across multiple types of evaluators when used in a skills lab course. Additional evaluation of the rubric and continuous quality improvement is warranted to ensure that assessment becomes more consistent with continued use, regardless of the evaluator type.
Sign-in/Register to access full text options 
Free) 
Talk to us
Join us for a 30 min session where you can share your feedback and ask us any queries you have
Schedule a call
