GPs' and physicians' interpretation of risks, benefits and diagnostic test results

Abstract

Understanding pre-test probability and baseline risks helps to interpret the results of diagnostic tests and the benefits of treatment, but how good is the understanding of these concepts? Our aim was to assess the ability of GPs and consultant physicians to make accurate estimates and understand the application of pre-test probability and baseline risk for two common clinical conditions. A two-stage questionnaire survey based on case scenarios of patients with angina and congestive heart failure was carried out of 202 physicians, randomly selected from the members of the Royal College of Physicians in the NW of England, 205 GPs randomly chosen from the practice list of the NW Health Authorities and 128 MRCGP examiners attending an examiners meeting. A total of 115, 106 and 81 members of these groups, respectively, responded to the first stage, and 44, 46 and 64 to the second. The main outcome measures were the stated likelihood of true ischaemic heart disease (IHD) being present and the predicted 1-year mortality; the impact of changing prevalence and baseline risk on these results; and interpretation of different methods of risk presentation. Estimates of pre-test probability of IHD being present ranged from 5 to 100% and of baseline risk of 1-year mortality from 0 to 86%. More GP examiners and consultant physicians understood the impact of increasing age on the test result than did the random sample of GPs. A majority of each group correctly said that increasing age would reduce the number needed to treat (NNT). Presentation of benefit as relative risk reduction was a greater stimulus to starting treatment than the NNT or measures of population impact. Clinicians should collect data to allow a better knowledge of the likelihood of disease and of baseline risk in their patient populations. Methods to increase the understanding of the influence of pre-test probability on diagnostic test results and of how to quantify and demonstrate the impact of the benefit of interventions should be explored.