Five groups of searchers each performed two of four pre‐selected searches on the DIALOG system using ONTAP, the 1975 subset of the Educational Resources Information Center (ERIC) database. The groups were novices, moderately experienced searchers without ERIC experience, moderately experienced searchers with ERIC experience, very experienced searchers without ERIC experience, and very experienced searchers with ERIC experience. Data were collected on the education, online training, online experience, institutional setting, and personal characteristics of the rearchers. Variables that describe the search process (e.g. number of commands used) and variables that describe the outcome of searches (e.g. recall) were measured by examination of the search transcripts. The results showed that, compared to the experienced subjects, the novices performed surprisingly well. Although, as a group, they searched more slowly than the experienced subjects and scored lower on most (but not all) outcome measures, the differences were not as great as might be expected. Three meaningful patterns were identified among the experienced subjects' searches: (1) the group with the greatest overall experience and the greatest ERIC database experience achieved the highest recall and had the highest values of a subset of search process variables designated ‘search effort’ variables (e.g. number of commands and descriptors, connect time); (2) in general, the moderately experienced searchers with ERIC experience performed the briefest, most cost effective searches (when cost effectiveness is measured in terms of time per relevant reference retrieved). This pattern is attributed to the fact that 75 percent of this group work in academic libraries that charge individual users for online connect time. In this situation pressure to keep costs low appears to be great; (3) the subjects with ERIC experience used more thesaurus terms than the subjects without ERIC experience. The subjects without ERIC experience tended to prefer free text to thesaurus terms. In regard to outcome, only slight evidence was found to support the hypothesis that ERIC database experience leads to greater success in searching.
Read full abstract