Response Bias in Computerised Tests

Abstract

AbstractChoosing a response format is a problem when designing computerised tests. Programmers often solve this problem by highlighting a response option and allowing the user to select this option or choose another by using the cursor keys. It is possible that such well-meaning attempts to make computers more user-friendly may heighten response style tendencies. The two experiments to be reported in this study were designed to test the effect of cursor positioning in personality and ability tests. In the first experiment, sixty two Participants were randomly assigned to two groups and asked to complete computerised versions of Forms A and B of the Eysenck Personality Inventory. The position of the highlight was manipulated to produce a two-by-two factorial design with repeated measures on one factor. Results showed that there was evidence of a cursor effect but that it was confined to one of the conditions in the design. Experiment two employed the same sort of manipulation in a computerised version of the ACER Word Knowledge Test with another sample of 36 Participants. Here, no evidence was found for any effect of cursor positioning. Overall, it was concluded that the highlighting technique itself is unlikely to have any effect on measures of cognitive ability but that it may have some effect in the more subjective personality testing domain.