Evaluating the impact of a simulation study in emergency stroke care

Abstract

Very few discrete-event simulation studies follow up on recommendations with evaluation of whether modelled benefits have been realised and the extent to which modelling contributed to any change. This paper evaluates changes made to the emergency stroke care pathway at a UK hospital informed by a simulation modelling study. The aims of the study were to increase the proportion of people with strokes that undergo a time-sensitive treatment to breakdown a blood clot within the brain and decrease the time to treatment. Evaluation involved analysis of stroke treatment pre- and post-implementation, as well as a comparison of how the research team believed the intervention would aid implementation compared to what actually happened. Two years after the care pathway was changed, treatment rates had increased in line with expectations and the hospital was treating four times as many patients than before the intervention in half the time. There is evidence that the modelling process aided implementation, but not always in line with expectations of the research team. Despite user involvement throughout the study it proved difficult to involve a representative group of clinical stakeholders in conceptual modelling and this affected model credibility. The research team also found batch experimentation more useful than visual interactive simulation to structure debate and decision making. In particular, simple charts of results focused debates on the clinical effectiveness of drugs — an emergent barrier to change. Visual interactive simulation proved more useful for engaging different hospitals and initiating new projects.