External Quality Assessment of Microbial Counts from Water: To Score or Not to Score for Proficiency

Abstract

Scoring schemes were first introduced in water-chemistry inter-laboratory proficiency tests. Such scoring does not behave in a comparable manner when applied to microbiology external quality assessment. Conventional scores can become a lottery. This poses a challenge to (a) find helpful statistical methods which will look beyond this natural variation and (b) attempt to identify any poor performance by the participants. The aim is to provide useful management tools. In the Public Health Laboratory Service, water external quality assessment scheme participants have detected methodology problems. Formal analyses are carried out on cumulated results in two stages, first demonstrating whether there is any systematic difference between laboratories of microbiological as well as statistical significance and only then allocating participants to categories of acceptable, or poor, performance. The scheme has been operating for several years and performance improvements are evident.