Abstract
Most psychological questionnaires face issues of response bias in respondent-reported scales, inadequacy for criterion-reference testing, or difficulty in estimating a large number of latent traits. Situational tests together with the general nominal diagnosis model framework provide a viable alternative to alleviate these concerns. Under this framework, there are different ways to design situationally nominal items, which can offer more flexibility for test development. Any response bias remaining with respondent-reported questionnaires may be addressed with appropriate test designs. The saturated model subsumes different reduced forms that can help inform whether the test is designed as expected. Two simulation studies are presented to demonstrate the effectiveness of the models and designs.
Highlights
Most existing measures of behavioral or psychological constructs for typical performance have some drawbacks
Since the pattern-expected diagnosis model (PEDM) parameters were transformed from the GNDM ones, the biases and reliabilities of the estimates for the saturated model can be inferred through Table 9 as well
One can create a large number of items that are substantively different in content if needed
Summary
Most existing measures of behavioral or psychological constructs for typical performance (e.g., personality, emotion, temperament, and attitude) have some drawbacks. CDMs have been successfully applied to cognitive situational judgment tests with dichotomous responses for competency [22] and personnel selection [23] to overcome some reliability and validity issues These developments make it more feasible to integrate CDMs with situational formats and nominal responses for typical performance. The construction of nominal items for typical performance should be based on an assumption that all attribute patterns and response options are treated during the modeling process. This means that neither the test designs nor the models for maximal performance can be directly used for typical performance. The third difference and even some of the second difference between the two models would disappear if the MC-DINA model were to be extended by replacing the DINA part with the G-DINA model
Talk to us
Join us for a 30 min session where you can share your feedback and ask us any queries you have