Abstract
Response styles, the general tendency to use certain categories of rating scales over others, are a threat to the reliability and validity of self-report measures. The mixed partial credit model, the multidimensional nominal response model, and the item response tree model are three widely used models for measuring extreme and midpoint response styles and correcting their effects. This research aimed to examine and compare their validity by fitting them to empirical data and correlating the content-related factors and the response style-related factors in these models to extraneous criteria. The results showed that the content factors yielded by these models were moderately related to the content criterion and not related to the response style criteria. The response style factors were moderately related to the response style criteria and weakly related to the content criterion. Simultaneous analysis of more than one scale could improve their validity for measuring response styles. These findings indicate that the three models could control and measure extreme and midpoint response styles, though the validity of the mPCM for measuring response styles was not good in some cases. Overall, the multidimensional nominal response model performed slightly better than the other two models.
Highlights
Response styles refer to the systematic preference or avoidance of certain response categories in assigning ratings to personality and attitudinal items (Paulhus, 1991)
Past research has revealed that response styles may be conceptualized as trait-like constructs that are stable across time (Weijters et al, 2010b), consistent across scales (Wetzel et al, 2013), and related to respondent characteristics, such as personality traits (Naemi et al, 2009)
There was a weak association between the content factor and the midpoint response style (MRS) criterion in the mixed partial credit models (mPCM) and multidimensional nominal response model (MNRM), and there was a clear dissociation between the two variables in the IR tree model
Summary
Response styles refer to the systematic preference or avoidance of certain response categories in assigning ratings to personality and attitudinal items (Paulhus, 1991). Past research has revealed that response styles may be conceptualized as trait-like constructs that are stable across time (Weijters et al, 2010b), consistent across scales (Wetzel et al, 2013), and related to respondent characteristics, such as personality traits (Naemi et al, 2009). They can cause biased scale scores (Moors, 2012; Mottus et al, 2012) and correlations (e.g., Baumgartner and Steenkamp, 2001), and underestimation of measurement invariance (e.g., Liu et al, 2017).
Sign-in/Register to view highlights & summary Sign-in/Register to access full text options 
Talk to us
Join us for a 30 min session where you can share your feedback and ask us any queries you have
Schedule a call
