Therapists are often poor judges of clients' improvement and their judgments can be biased in either direction, false positive, or false negative. This study reports a method for reducing this bias. Twenty clients being transferred from one therapist to another as part of a normal rotation were studied. Two therapists terminating treatment and two new therapists (five clients each) filled out an 80-item questionnaire on each client giving the most realistic evaluation of the client's pathology. Another two terminating and two new therapists (five clients each) completed the same questionnaire twice-once giving the most optimistic and once the most pessimistic evaluation on each client's pathology. AU 20 clients were then seen for four sessions by two (10 clients each) experienced, expert diagnosticians to determine which new therapist was appropriate. The 10 clients (Group A) had the same assessment done by the old therapist, the new therapist, and an expert. Ten clients (Group B) had the same assessment done by the expert but had both an optimistic and pessimistic evaluation done by the old therapist and the new therapist. The data for every clients' questionnaire were run through a computer program designed by the author that yields every DSM-111 diagnosis for which there is substantial evidence or some evidence. Every client was given a pathology score, generated by giving the dient two points for each diagnosis with substantial evidence and one point for every diagnosis with only some evidence. For the therapists who had made two evaluations, the pathology points assigned were based on the mean of the optimistic and pessimistic assessments. An analysis of variance was performed on the pathology scores for both groups. Old therapists gave the clients a mean pathology score of 3.3, new therapists gave a rating of 5.2, while experts gave a rating of 4.7 (F2,,B = 13.16, p<.001) A Newman-Keuls post hoc test indicated all individual comparisons were significant. In Group B, the mean of optimistic and pessimistic ratings for old therapists was 3.4, for new therapists was 3.4 and experts' ratings were 3.6 (F,,,, = 0.72, ns). Asking the more novice therapists (old or new) to give the range of pathology rather than a most accurate assessment yielded better agreement with experts.
Read full abstract