Abstract
Abstract : Generalizability (G) theory was used to assess the reliability of criterion measures across four Air Force specialties. This analysis strategy was applied to work sample tests (i.e., Walk-Through Performance Test (WTPT) scores) and ratings of job proficiency. Results indicated that WTPT scores were reliable with each specialty. In addition, ratings were reliable across different rating forms (i.e., general to specific) and within rating sources (i.e., incumbents, peers, and supervisors). However, ratings were not generalizable across rating sources, and ratings were not substitutable for WTPT scores. These results were consistent across the four specialties, lending increased confidence to the findings. G-theory, Generalizability, Job performance measurement, Performance ratings, Reliability, Walk-through performance test, Work sample test.
Published Version
Talk to us
Join us for a 30 min session where you can share your feedback and ask us any queries you have