Item-level Analyses Research Articles

Purpose in life is reduced in subjects with mild cognitive impairment and dementia compared to cognitively intact persons: An item level analysis

Purpose in life is reduced in subjects with mild cognitive impairment and dementia compared to cognitively intact persons: An item level analysis

An item-level analysis of the Posttraumatic Growth Inventory: Relationships with an examination of core beliefs and deliberate rumination

Posttraumatic growth (PTG), positive change that may occur as a result of psychological struggle with a traumatic event, has been widely reported across cultures. However, there is some disagreement on how the self-reported PTG, measured by the PTG Inventory (PTGI), reflects the construct that is described in PTG theory. The current study was designed to conduct an item-level analysis of the PTGI to identify the type of growth that is explained by an examination of one's core beliefs and deliberate rumination — two major precursors for PTG, according to a PTG theoretical model. A multivariate multiple regression analysis predicting each of the PTGI items was conducted with young adults who experienced the Great East Japan Earthquake (N=316). Results indicated that five out of 21 items were explained by both core beliefs' examination and deliberate rumination and 13 were explained by only core beliefs' examination. Three items were not accounted for by either core beliefs' examination or deliberate rumination. These findings indicate that most types of PTG assessed by the PTGI are likely to occur when core beliefs are challenged; however, some types of PTG may occur without cognitive effort. Future research should consider the variation within the PTGI.

Sense of direction: General factor saturation and associations with the Big-Five traits

The ability to locate and orient ourselves with respect to environmental space is known as sense of direction (“SOD”). While there is considerable evidence for the predictive utility of self-report measures of this psychological construct, relatively little research has investigated the psychometric properties of the self-report scale by which it is most commonly measured – the Santa Barbara Sense of Direction scale (SBSOD, Hegarty et al., 2002) – or the broader personality correlates. The present study evaluated the factor structure of the SBSOD following administration to 12,155 individuals and situated it among prominent sources of individual differences, specifically the Big Five personality traits and intelligence. Findings suggest that the SBSOD scale has relatively high general factor saturation, and that a considerable portion of the variance in SBSOD scores is explained by other personality traits, including Conscientiousness (r=0.33), Intellect (r=0.27), Emotional Stability (r=0.26), and Extraversion (r=0.23). Cognitive ability was less highly correlated with SBSOD scores when measured at the level of general intelligence (r=0.11) and in terms of mental rotation ability (r=.07). Recommendations are given for revision of the SBSOD scale based on item-level analyses.

Sleep maintenance, spindling excessive beta and impulse control: an RDoC arousal and regulatory systems approach?

In 2009 the United States National Institute of Mental Health (NIMH) introduced the Research Domain Criteria (RDoC) project, which intends to explicate fundamental bio-behavioral dimensions that cut across heterogeneous disorder categories in psychiatry. One major research domain is defined by arousal and regulatory systems. In this study we aimed to investigate the relation between arousal systems (EEG-beta phenotypes also referred to as spindling excessive beta (SEB), beta spindles or sub-vigil beta) and the behavioral dimensions: insomnia, impulsivity/hyperactivity and attention. This analysis is conducted within a large and heterogeneous outpatient psychiatric population, in order to verify if EEG-beta phenotypes are an objective neurophysiological marker for psychopathological properties shared across psychiatric disorders. SEBs had an occurrence between 0–10.8% with a maximum occurrence at frontal and central locations, with similar topography for the heterogeneous sample as well as a more homogenous ADHD subgroup. Patients with frontal SEBs only, had significantly higher impulsivity/hyperactivity (specifically on impulse control items) and insomnia complaints with medium effect sizes. Item level and mediation analysis revealed that sleep maintenance problems explained both frontal SEB EEG patterns (in line with SEB as a sub-vigil or hypoarousal EEG pattern) as well as the impulse control problems. These data thus suggest that frontal SEB might be regarded as a state marker caused by sleep maintenance problems, with concurrent impulse control problems. However, future longitudinal studies should investigate this state-trait issue further and replicate these findings Also studies manipulating SEB by for example neurofeedback and measuring consequent changes in sleep and impulse control could shed further light on this issue.

Tic symptom dimensions and their heritabilities in Tourette's syndrome.

Gilles de la Tourette's syndrome (TS) is both genotypically and phenotypically heterogeneous. Gene-finding strategies have had limited success, possibly because of symptom heterogeneity. This study aimed at specifically investigating heritabilities of tic symptom factors in a relatively large sample of TS patients and family members. Lifetime tic symptom data were collected in 494 diagnosed individuals in two cohorts of TS patients from the USA (n=273) and the Netherlands (n=221), and in 351 Dutch family members. Item-level factor analysis, using a tetrachoric correlation matrix in SAS (v9.2), was carried out on 23 tic symptoms from the Yale Global Tic Severity Scale. Three factors were identified explaining 49% of the total variance: factor 1, complex vocal tics and obscene behaviour; factor 2, body tics; and factor 3, head/neck tics. Using Sequential Oligogenic Linkage Analysis Routine, moderate heritabilities were found for factor 1 (h2r=0.21) and factor 3 (h2r=0.25). Lower heritability was found for overall tic severity (h2r=0.19). Bivariate analyses indicated no genetic associations between tic factors. These findings suggest that (i) three tic factors can be discerned with a distinct underlying genetic architecture and that (ii) considering the low tic heritabilities found, only focusing on the narrow-sense TS phenotype and leaving out comorbidities that are part of the broader sense tic phenotype may lead to missing heritability. Although these findings need replication in larger independent samples, they might have consequences for future genetic studies in TS.

Metacognition in First Episode Psychosis: Item Level Analysis of Associations with Symptoms and Engagement

Significant metacognitive impairments are observed in first episode psychosis (FEP) and chronic psychosis samples. There is evidence of associations between metacognition and presentation in FEP, but the relative contribution of metacognitive understanding of the self and the other is as yet unclear. The current study is a secondary analysis of date on metacognition, symptoms and engagement with treatment (help-seeking) in an FEP sample. In a cross-sectional cohort study, individuals in the first 12 months of treatment metacognition were assessed with the Metacognition Assessment Scale-Revised version (MAS-R). Psychotic symptomatology and help-seeking within treatment (clinician-rated service engagement) were also measured. An item level analysis of the MAS-R was conducted exploring associations between symptoms and cognitive, emotional, differentiation, integration and decentration aspects of metacognition. We report that associations between negative symptoms and deficits in the understanding of other's mental states extend across cognitive, emotional, integrative and decentration aspects of metacognition. We also report associations between negative symptoms and understanding one's own mind. We also note that cognitive and decentration aspects of metacognition were significantly associated with help-seeking once in treatment. Our findings suggest that an appreciation of metacognitive processes may inform treatment frameworks for FEP. Copyright © 2015 John Wiley & Sons, Ltd. Individual components of metacognition including the capacity to relate cognitive and emotional variables are important in first episode phychosis. Impaired metacognitive understanding of both one's own and others' mental states is associated with increased negative symptoms. Metacognitive variables may be important in understanding how different individuals seek help or engage with services after the initiation of treatment.

Assessing Item-Level Fit for the DINA Model.

This research focuses on developing item-level fit checking procedures in the context of diagnostic classification models (DCMs), and more specifically for the "Deterministic Input; Noisy 'And' gate" (DINA) model. Although there is a growing body of literature discussing model fit checking methods for DCM, the item-level fit analysis is not adequately discussed in literature. This study intends to take an initiative to fill in this gap. Two approaches are proposed, one stems from classical goodness-of-fit test statistics coupled with the Expectation-Maximization algorithm for model estimation, and the other is the posterior predictive model checking (PPMC) method coupled with the Markov chain Monte Carlo estimation. For both approaches, the chi-square statistic and a power-divergence index are considered, along with Stone's method for considering uncertainty in latent attribute estimation. A simulation study with varying manipulated factors is carried out. Results show that both approaches are promising if Stone's method is imposed, but the classical goodness-of-fit approach has a much higher detection rate (i.e., proportion of misfit items that are correctly detected) than the PPMC method.

Negative decision outcomes are more common among people with lower decision-making competence: an item-level analysis of the Decision Outcome Inventory (DOI).

Most behavioral decision research takes place in carefully controlled laboratory settings, and examination of relationships between performance and specific real-world decision outcomes is rare. One prior study shows that people who perform better on hypothetical decision tasks, assessed using the Adult Decision-Making Competence (A-DMC) measure, also tend to experience better real-world decision outcomes, as reported on the Decision Outcomes Inventory (DOI). The DOI score reflects avoidance of outcomes that could result from poor decisions, ranging from serious (e.g., bankruptcy) to minor (e.g., blisters from sunburn). The present analyses go beyond the initial work, which focused on the overall DOI score, by analyzing the relationships between specific decision outcomes and A-DMC performance. Most outcomes are significantly more likely among people with lower A-DMC scores, even after taking into account two variables expected to produce worse real-world decision outcomes: younger age and lower socio-economic status. We discuss the usefulness of DOI as a measure of successful real-world decision-making.

Responding to nonwords in the lexical decision task: Insights from the English Lexicon Project.

Researchers have extensively documented how various statistical properties of words (e.g., word frequency) influence lexical processing. However, the impact of lexical variables on nonword decision-making performance is less clear. This gap is surprising, because a better specification of the mechanisms driving nonword responses may provide valuable insights into early lexical processes. In the present study, item-level and participant-level analyses were conducted on the trial-level lexical decision data for almost 37,000 nonwords in the English Lexicon Project in order to identify the influence of different psycholinguistic variables on nonword lexical decision performance and to explore individual differences in how participants respond to nonwords. Item-level regression analyses reveal that nonword response time was positively correlated with number of letters, number of orthographic neighbors, number of affixes, and base-word number of syllables, and negatively correlated with Levenshtein orthographic distance and base-word frequency. Participant-level analyses also point to within- and between-session stability in nonword responses across distinct sets of items, and intriguingly reveal that higher vocabulary knowledge is associated with less sensitivity to some dimensions (e.g., number of letters) but more sensitivity to others (e.g., base-word frequency). The present findings provide well-specified and interesting new constraints for informing models of word recognition and lexical decision.

Differential Item Functioning: Item Level Analysis of TIMSS Mathematics Test Items Using Australian and Indonesian Database

The Trends in International Mathematics and Science Study (TIMSS) aims to provide a broad perspective for evaluating and improving education. This assessment also ranks the participant countries based on their performance and makes inferences about factors affecting achievement and learning. However, the study may not function as it was expected because of differences in curricular, cultural, or language settings among countries. Consequently, this challenges assumptions about measurement equivalency. The present study aims to assess the equivalency of mathematics items on the TIMSS (2007) study across Australian and Indonesia. Students’ responses were subjected to Rasch analysis to determine DIF items. The results revealed that many items of mathematics tests are problematic because they showed significant bias. The study also found that Australian students performed better and found mathematics items on the test easier than their Indonesian counterparts did. Several factors such as curricular differences, methods used to solve mathematics problems, availability of textbooks and teachers’ quality might explain the existence of DIF between the countries. These findings indicate that serious limitations of using TIMSS results in comparing the performance of students across countries. Thus, further empirical evidence is needed before TIMSS 2007 results can be meaningfully used in research.

Differential Item Functioning: Item Level Analysis of TIMSS Mathematics Test Items Using Australian and Indonesian Database

The Trends in International Mathematics and Science Study (TIMSS) aims to provide a broad perspective for evaluating and improving education. This assessment also ranks the participant countries based on their performance and makes inferences about factors affecting achievement and learning. However, the study may not function as it was expected because of differences in curricular, cultural, or language settings among countries. Consequently, this challenges assumptions about measurement equivalency. The present study aims to assess the equivalency of mathematics items on the TIMSS (2007) study across Australian and Indonesia. Students’ responses were subjected to Rasch analysis to determine DIF items. The results revealed that many items of mathematics tests are problematic because they showed significant bias. The study also found that Australian students performed better and found mathematics items on the test easier than their Indonesian counterparts did. Several factors such as curricular differences, methods used to solve mathematics problems, availability of textbooks and teachers’ quality might explain the existence of DIF between the countries. These findings indicate that serious limitations of using TIMSS results in comparing the performance of students across countries. Thus, further empirical evidence is needed before TIMSS 2007 results can be meaningfully used in research. Keywords: DIF items, mathematics test items, Rasch model

Further Consideration of Advanced Clinical Solutions Word Choice: Comparison to the Recognition Memory Test-Words and Classification Accuracy in a Clinical Sample

Word Choice (WC), a test in the Advanced Clinical Solutions package for Wechsler measures, was examined in two studies. The first study compared WC to the Recognition Memory Test-Words (RMT-W) in a clinical sample (N = 46). WC scores were significantly higher than RMT-W scores overall and in sample subsets grouped by separate validity indicators. In item-level analyses, WC items demonstrated lower frequency, greater imageability, and higher concreteness than RMT-W items. The second study explored WC classification accuracy in a different clinical sample grouped by separate validity indicators into Pass (n = 54), Fail-1 (n = 17), and Fail-2 (n = 8) groups. WC scores were significantly higher in the Pass group (M = 49.1, SD = 1.9) than in the Fail-1 (M = 46.0, SD = 5.3) and Fail-2 (M = 44.1, SD = 4.8) groups. WC demonstrated area under the curve of .81 in classifying Pass and Fail-2 participants. Using the test manual cutoff associated with a 10% false positive rate, sensitivity was 38% and specificity was 96% in Pass and Fail-2 groups with 24% of Fail-1 participants scoring below cutoff. WC may be optimally used in combination with other measures given observed sensitivity.

Item-level factor analysis of the schizotypal personality questionnaire yields five gender-invariant factors

Item-level factor analysis of the schizotypal personality questionnaire yields five gender-invariant factors

Impact of Alzheimer's Disease on Caregiver Questionnaire: internal consistency, convergent validity, and test-retest reliability of a new measure for assessing caregiver burden.

BackgroundThere is a lack of validated instruments to measure the level of burden of Alzheimer’s disease (AD) on caregivers. The Impact of Alzheimer’s Disease on Caregiver Questionnaire (IADCQ) is a 12-item instrument with a seven-day recall period that measures AD caregiver’s burden across emotional, physical, social, financial, sleep, and time aspects. Primary objectives of this study were to evaluate psychometric properties of IADCQ administered on the Web and to determine most appropriate scoring algorithm.MethodsA national sample of 200 unpaid AD caregivers participated in this study by completing the Web-based version of IADCQ and Short Form-12 Health Survey Version 2 (SF-12v2™). The SF-12v2 was used to measure convergent validity of IADCQ scores and to provide an understanding of the overall health-related quality of life of sampled AD caregivers.The IADCQ survey was also completed four weeks later by a randomly selected subgroup of 50 participants to assess test-retest reliability. Confirmatory factor analysis (CFA) was implemented to test the dimensionality of the IADCQ items. Classical item-level and scale-level psychometric analyses were conducted to estimate psychometric characteristics of the instrument. Test-retest reliability was performed to evaluate the instrument’s stability and consistency over time.ResultsVirtually none (2%) of the respondents had either floor or ceiling effects, indicating the IADCQ covers an ideal range of burden. A single-factor model obtained appropriate goodness of fit and provided evidence that a simple sum score of the 12 items of IADCQ can be used to measure AD caregiver’s burden. Scales-level reliability was supported with a coefficient alpha of 0.93 and an intra-class correlation coefficient (for test-retest reliability) of 0.68 (95% CI: 0.50–0.80). Low-moderate negative correlations were observed between the IADCQ and scales of the SF-12v2.ConclusionsThe study findings suggest the IADCQ has appropriate psychometric characteristics as a unidimensional, Web-based measure of AD caregiver burden and is supported by strong model fit statistics from CFA, high degree of item-level reliability, good internal consistency, moderate test-retest reliability, and moderate convergent validity. Additional validation of the IADCQ is warranted to ensure invariance between the paper-based and Web-based administration and to determine an appropriate responder definition.

C-32 * A Little Knowledge is a Dangerous Thing Part 2: Survey of Empirically-Based Knowledge of Return-to-Play Guidelines using the RoCKAS

Objective: Research has shown substantial misconceptions regarding return-to-play (RTP) guidelines following mild traumatic brain injury (mTBI)/concussions among the general public. The purpose of this study was to explore the current levels of misconceptions among college students and healthcare professionals. Method: Thirty-nine questions used in a previous survey by Rosenbaum and Arnett (2010) were used currently. One hundred fifty-three healthcare professionals (mean age = 43.44, SD = 12.81; 67% female; 87% white) and 415 undergraduate students (mean age = 20.63, SD = 5.23; 70% female; 64% white) were surveyed regarding their knowledge of RTP guidelines. Healthcare professionals were defined as physicians, nurses, and athletic trainers. Results: Multidimensional chi-square analyses were examined. Results indicated the pattern of responding was significantly different among healthcare professionals and undergraduate students (χ2(1) = 74.16, p < .001). Healthcare professionals responded accurately 84% of the time, whereas undergraduate students responded accurately 78% of the time. Chi-square analyses indicated no significant differences in the response pattern of athletic trainers (84% accuracy) and physicians (86% accuracy, χ2(1) = 2.24, p = 0.135). Significant differences were found when athletic trainers and physicians were combined (85% accuracy) and compared to nurses (81% accuracy, χ2(1) = 13.43, p < .001). Item level analysis revealed one question (“an athlete who gets knocked out after a concussion is experiencing a coma”), was incorrectly endorsed by 77% of physicians and 96% of athletic trainers. Conclusion(s): Frequency of misconceptions of RTP guidelines is significantly influenced by education and training within healthcare professionals. Current percentage of misconceptions is an improvement from older estimates.

Item-Level Assessment of the Irritable Bowel Syndrome Quality of Life Questionnaire in Patients With Diarrheal Irritable Bowel Syndrome

BackgroundIn previous studies, the Irritable Bowel Syndrome Quality of Life (IBS-QOL) instrument has been determined to have good measurement properties for general irritable bowel syndrome (IBS) and the diarrheal IBS (IBS-d) subtype in clinical trials. ObjectiveThis article aims to extend the true-score analyses that have been previously conducted to evaluate the IBS-QOL in IBS-d patients. MethodsItem response theory analysis was conducted by fitting models to responses from 753 patients with severe IBS-d from a recent clinical trial. Three item response theory models, the constrained graded response model (CGRM), the unconstrained GRM (UGRM), and the testlet response model (TRM), were fit to the 34 items of the IBS-QOL questionnaire. Subsequently, differential item functioning (DIF) for patient sex was assessed by fitting nested models by applying likelihood ratio tests. Model latent trait estimates were then compared with the IBS-QOL score and the IBS Symptom Severity Score. ResultsModel fits improved with complexity, with the TRM model fitting best compared with the CGRM and UGRM. The DIF evaluation for patient sex flagged 17 items for the CGRM and 9 items for the UGRM; however, these items were not found to have much effect on the overall estimation of the latent trait. Differential testlet functioning was not indicated, and no items exhibited potential DIF under the TRM because likelihood ratio tests were not statistically significant. Comparison of latent trait estimates to the IBS Symptom Severity Score and IBS-QOL questionnaire revealed high Spearman correlations (0.47 and ≥0.99, respectively). ConclusionPrevious true-score approach results were supported by the IBS-QOL item-level analysis. Further, the IBS-QOL total score was found to be a valid measure of perceived quality of life for IBS-d patients when compared with more sophisticated model-based estimates of perceived quality of life. ClinicalTrials.gov identifier: NCT01130272.

Computer use for entertainment among young men and women in Qatar: Evidence from a national sample

In this study we examined the home use of computers for entertainment among 15-year old students in Qatar using a national sample of 8601 students. Scale and item level analyses were performed in univariate and multivariate contexts in order to understand the relationship of computer use with computer availability, internet availability, and demographic differences such as gender and socioeconomic status. Our results suggested significant differences in mean entertainment use across gender and categories of computer and internet availability, while computer use and socioeconomic status were found to be moderately correlated. Implications were discussed.

¿Matrices Policóricas/Tetracóricas o Matrices Pearson? Un estudio metodológico

The use of product-moment correlation of Pearson is common in most studies in factor analysis in psychology, but it is known that this statistic is only applicable when the variables related are in interval scale and normally distributed, and when are used in ordinal data may to produce a distorted correlation matrix . Thus is a suitable option using polychoric/tetrachoric matrices in item-level factor analysis when the items are in level measurement nominal or ordinal. The aim of this study was to show the differences in the KMO, Bartlett`s Test and Determinant of the Matrix, percentage of variance explained and factor loadings in depression trait scale of Depression Inventory Trait - State and the Neuroticism dimension of the short form of the Eysenck Personality Questionnaire -Revised, regarding the use of matrices polychoric/tetrachoric matrices and Pearson. These instruments was analyzed with different extraction methods (Maximum Likelihood, Minimum Rank Factor Analysis, Unweighted Least Squares and Principal Components), keeping constant the rotation method Promin were analyzed. Were observed differences regarding sample adequacy measures, as well as with respect to the explained variance and the factor loadings, for solutions having as polychoric/tetrachoric matrix. So it can be concluded that the polychoric / tetrachoric matrix give better results than Pearson matrices when it comes to item-level factor analysis using different methods.

The Role of Copyright in Selection for Digitization

This article reports the findings of a study of the impact of copyright on what U.S. archival repositories select for digitization and the extent to which they seek authorization from rights holders. Based on the website content of 96 repositories, 66 survey responses, and 18 interviews, the findings reveal a wide range of practice. While American repositories are generally conservative in that they digitize holdings that present no copyright complications, there is evidence of a shift from an item-level copyright analysis approach to a bolder risk-assessment approach that may better achieve the archival mission to make holdings available for use. The article identifies tools to support a risk-assessment approach and suggests areas of further research to identify best practices.

Functional and psychosocial impact of strabismus on Singaporean children

To quantify the effects of strabismus in Singaporean children using the Intermittent Exotropia Questionnaire (IXTQ) and the Adult Strabismus 20 Questionnaire (AS20). Consecutive strabismus patients 5-16 years of age were recruited along with an equal number of age-matched controls with eye conditions other than strabismus and amblyopia (group A) and controls with no known eye conditions (group B). All children completed the IXTQ; those 8-16 years of age also completed the AS20 questionnaire. Parents completed the parental proxy IXTQ (pp-IXTQ) and AS20 (pp-AS20) and a parental IXTQ (PIXT). A total of 60 patients and 60 age-matched controls in each group were included. Children with strabismus had lower IXTQ (70.1 ± 19.0) and AS20 (80.0 ± 13.8) scores than those in group B (IXTQ, 90.3 ± 11.8 [P < 0.001]; AS20, 90.0 ± 10.9 [P < 0.001]) and group A (IXTQ, 80.6 ± 14.9 [P = 0.001]; AS20, 81.6 ± 18.3 [P = 0.691]). Among children with strabismus, child IXTQ scores were significantly lower than parental proxy scores (70.1 ± 19.0 vs 76.4 ± 15.8 [P = 0.026]), but there was no difference in control group scores or with AS20 scores. Item-level analysis suggested that children's worry focused on what others thought about them and their ability to make friends, whereas parents were more concerned about eyesight and whether surgery was required. The IXTQ and AS20 were better at differentiating between children with strabismus and those with no eye condition than between children with strabismus and other eye conditions. Parental proxies were accurate in predicting child scores but parents were more likely to underestimate the psychosocial effects of their children's strabismus.