Application Of Item Response Theory Research Articles

Reliability and validity of simple Chinese version of grit scale for elementary school students

BackgroundThe Grit scale (GS-12) is a widely used rating scale that assess passion and perseverance. The present study aimed to evaluate the reliability and validity of simple Chinese Version of Grit Scale (GS-SC) among Chinese adolescents.MethodsSeven hundred one primary school students were recruited as Sample 1. Item analysis and exploratory factor analysis (EFA) were conducted on Sample 1 to preliminarily examine the structure of the scale. Sample 2 consisted of 5,384 primary school students. Confirmatory factor analysis (CFA) and verification of reliability and validity were conducted on Sample 2 to establish a formal scale and further verify the psychometric properties by applying item response theory (IRT).ResultsEFA and CFA revealed a clear two-factor structure. The results demonstrated that the Simplified Chinese Version of Grit Scale had adequate internal consistency and re-test reliability. GS-CS also showed good criterion-validity with personality, self-control, effort regulation and academic achievement. Furthermore, all the items show a acceptable fit to the GRM and have good discrimination (ranging from 2.13 to 3.45) and moderate difficulty(ranging from-1.58 to 0.95).ConclusionsThe reliability and validity of the GS-SC are good, indicating that the scale can be used as an effective tool for measuring the grit of primary school students in China.

Measuring risky loot box use: An item response theory analysis of the Risky Loot Box Index among adolescents.

Loot boxes (LBs) are virtual items embedded within video games that contain randomly generated in-game prizes. LB use can become risky, so it is important to have good measurement instruments, especially among adolescents, who are particularly involved in video gaming and LB purchasing. The present study analyses the adequacy of the Risky Loot Box Index (RLI; Brooks & Clark, 2019) by applying item response theory (IRT). Participants were 2,443 (59% males, mean age = 16.48, SD = 1.22) Italian high school students. The 2PL logistic model was applied. Item properties (i.e., severity and discrimination) were consistent with the aim of efficiently measuring risky LB use. The test information function indicated that the instrument was adequately informative. The RLI appeared to be invariant across gender, with male adolescents more at-risk than female adolescents. LB engagement was also found to explain latent trait of risky LB use over and beyond video gaming and gambling frequency and severity when controlling for gender. The RLI is an efficient screening tool that can specifically measure risky LB use among youth. It can profitably be used for research and intervention purposes. The promising usefulness of the IRT score for clinical purposes is also discussed. (PsycInfo Database Record (c) 2024 APA, all rights reserved).

Item Response Theory Validation of the Forgotten Joint Score for Persons Undergoing Total Knee Replacement.

The Forgotten Joint Score (FJS), a commonly used patient-reported outcome measure, was developed without fully confirming assumptions such as unidimensionality (all items reflect 1 underlying factor), appropriate weighting of each item in scoring, absence of differential item functioning (in which different groups, e.g., men and women, respond differently), local dependence (pairs of items are measuring only 1 underlying factor), and monotonicity (persons with higher function have a higher score). We applied item response theory (IRT) to perform validation of the FJS according to contemporary standards, and thus support its ongoing use. We aimed to confirm that the FJS reflects a single latent trait. In addition, we aimed to determine whether an IRT model could be fitted to the FJS. Participants undergoing primary total knee replacement provided responses to the FJS items preoperatively and at 6 and 12 months postoperatively. An exploratory factor analysis (EFA), confirmatory factor analysis (CFA), and Mokken analysis were conducted. A graded response model (GRM) was fitted to the data. A total of 1,774 patient responses were analyzed. EFA indicated a 1-factor model (all 12 items reflecting 1 underlying trait). CFA demonstrated an excellent model fit. Items did not have equal weighting. The FJS demonstrated good monotonicity and no differential item functioning by sex, age, or body mass index. GRM parameters are reported in this paper. The FJS meets key validity assumptions, supporting its use in clinical practice and research. The IRT-adapted FJS has potential advantages over the traditional FJS: it provides continuous measurements with finer granularity between health states, includes individual measurement error, and can compute scores despite more missing data (with only 1 response required to estimate a score). It can be applied retrospectively to existing data sets or used to deliver individualized computerized adaptive tests. Prognostic Level II. See Instructions for Authors for a complete description of levels of evidence.

Genetic associations with dementia-related proteinopathy: Application of item response theory.

Although dementia-related proteinopathy has a strong negative impact on public health, and is highly heritable, understanding of the related genetic architecture is incomplete. We applied multidimensional generalized partial credit modeling (GPCM) to test genetic associations with dementia-related proteinopathies. Data were analyzed to identify candidate single nucleotide variants for the following proteinopathies: Aβ, tau, α-synuclein, and TDP-43. Final included data comprised 966 participants with neuropathologic and WGS data. Three continuous latent outcomes were constructed, corresponding to TDP-43-, Aβ/Tau-, and α-synuclein-related neuropathology endophenotype scores. This approach helped validate known genotype/phenotype associations: for example, TMEM106B and GRN were risk alleles for TDP-43 pathology; and GBA for α-synuclein/Lewy bodies. Novel suggestive proteinopathy-linked alleles were also discovered, including several (SDHAF1, TMEM68, and ARHGEF28) with colocalization analyses and/or high degrees of biologic credibility. A novel methodology using GPCM enabled insights into gene candidates for driving misfolded proteinopathies. Latent factor scores for proteinopathies were estimated using a generalized partial credit model. The three latent continuous scores corresponded well with proteinopathy severity. Novel genes associated with proteinopathies were identified. Several genes had high degrees of biologic credibility for dementia risk factors.

Genotype-Environment Interaction in ADHD: Genetic Predisposition Determines the Extent to Which Environmental Influences Explain Variability in the Symptom Dimensions Hyperactivity and Inattention

Although earlier research has shown that individual differences on the spectrum of attention deficit hyperactivity disorder (ADHD) are highly heritable, emerging evidence suggests that symptoms are associated with complex interactions between genes and environmental influences. This study investigated whether a genetic predisposition [Note that the term ‘genetic predisposition’ was used in this manuscript to refer to an estimate based on twin modeling (an individual’s score on the latent trait that resembles additive genetic influences) in the particular population being examined.] for the symptom dimensions hyperactivity and inattention determines the extent to which unique-environmental influences explain variability in these symptoms. To this purpose, we analysed a sample drawn from the Twins Early Development Study (TEDS) that consisted of item-level scores of 2168 16-year-old twin pairs who completed both the Strengths and Difficulties Questionnaire (SDQ; Goodman, in J Child Psychol Psychiatry 38:581–586, 1997) and the Strength and Weaknesses of ADHD Symptoms and Normal Behavior (SWAN; Swanson, in Paper presented at the meeting of the American Psychological Association, Los Angeles, 1981) questionnaire. To maximize the psychometric information to measure ADHD symptoms, psychometric analyses were performed to investigate whether the items from the two questionnaires could be combined to form two longer subscales. In the estimation of genotype-environment interaction, we corrected for error variance heterogeneity in the measurement of ADHD symptoms through the application of item response theory (IRT) measurement models. A positive interaction was found for both hyperactivity (e.g., β1\\documentclass[12pt]{minimal} \\usepackage{amsmath} \\usepackage{wasysym} \\usepackage{amsfonts} \\usepackage{amssymb} \\usepackage{amsbsy} \\usepackage{mathrsfs} \\usepackage{upgreek} \\setlength{\\oddsidemargin}{-69pt} \\begin{document}$${\\beta }_{1}$$\\end{document} = 2.20 with 95% highest posterior density interval equal to [1.79;2.65] and effect size equal to 3.00) and inattention (e.g., β1\\documentclass[12pt]{minimal} \\usepackage{amsmath} \\usepackage{wasysym} \\usepackage{amsfonts} \\usepackage{amssymb} \\usepackage{amsbsy} \\usepackage{mathrsfs} \\usepackage{upgreek} \\setlength{\\oddsidemargin}{-69pt} \\begin{document}$${\\beta }_{1}$$\\end{document} = 2.16 with 95% highest posterior density interval equal to [1.56;2.79] and effect size equal to 3.07). These results indicate that unique-environmental influences were more important in creating individual differences in both hyperactivity and inattention for twins with a genetic predisposition for these symptoms than for twins without such a predisposition.

종단 문항반응이론 기반 성장모형의 적용을 통한 중학생의 진로성숙도 변화 분석

With an emphasis on career education, career maturity has emerged as an important variable that, prompts analyses of its growth and changes. Previous studies examining career maturity longitudinally used raw scores as variables, which inevitably included errors. However, the application of the longitudinal item response theory allows for error-free growth modeling. In this study, longitudinal measurement invariance was confirmed by applying item response theory, and the feasibility of simultaneous analyses of items and information functions was demonstrated. In addition, to understand the changes in students' career maturity, a multi-group analysis by gender was conducted along with a linear growth model based on the longitudinal item response theory, which is a longitudinal extension of the item response theory. The results indicated that the items on the career maturity scale were generally acceptable. However, there was a lack of information to measure high levels of career maturity among first-year middle students. Career maturity in middle school exhibited a linear declining trend. In the multi-group analysis, female students showed lower initial levels than male students, but the decline was less pronounced. An interpretation and discussion of the research results, along with the limitations and suggestions for future research, are provided.

Genetic associations with mixed neuropathologies in the aging brainGenetic associations with mixed neuropathologies in the aging brain

AbstractBackground““Mixed” neuropathologies (NPs) are common in aged brains. Classic Alzheimer’s disease neuropathologic change (ADNC) proteinopathies are amyloid‐β plaques and tau neurofibrillary tangles (NFTs). In addition, α‐synuclein and TDP‐43 are also key proteinaceous disease markers, and cerebrovascular diseases (CVDs) often coexist. Although the scientific problems regarding mixed NPs are increasingly recognized, genetic associations with mixed NPs have not been well‐investigated. In this study, we applied item response theory (IRT) to optimize the clustering and combination of mixed NPs and examined the genetic associations.MethodNP data were drawn from the National Alzheimer’s Coordinating Center (NACC) NP v10‐11 forms through the March 2022 data freeze, including Thal phase ratings (A score); Braak NFT stage (B score); CERAD neuritic plaque scores (C score); Lewy bodies (LBs); TDP‐43; hippocampal sclerosis (HS); cerebral amyloid angiopathy (CAA); infarct and lacunes; microinfarcts; atherosclerosis of the circle of Willis; and brain arteriolosclerosis. We determined dominant pathology patterns in 1,228 participants who had no missing data using a multidimensional graded response model within the IRT framework. The NACC NP data were linked to the U.S. Alzheimer’s Disease Research Centers genetic data provided by the Alzheimer’s Disease genetic Consortium.ResultFrom the leave one out cross validation simulation, the model fitness tests showed that the 4‐factor model had fewer differences from the data than the other models. As shown in Figure, the predominant NPs were TDP‐43 and HS for factor 1 (F1), CVDs other than CAA for factor 2 (F2), A, B, and C scores and CAA for factor 3 (F3), and LBs for factor 4 (F4). The TMEM106B locus was genome‐wide significant with F1 (TDP‐43/HS) and the APOE locus was genome‐wide significant with F3 (ADNC/CAA) after adjusted for age at death, sex, and other factor scores. The SDK1 and FMNL2 loci were not genome‐wide significant, but had noteworthy associations with F2 (CVDs).ConclusionOur new approach to create mixed NP scores could detect the TMEM106B and APOE loci as TDP‐43/HS related and ADNC related regions, respectively. Although previous studies reported SDK1 as an ADNC related gene, we showed that the gene may be associated with CVDs.

Development and Validation of the Brief Math Anxiety Scale (BMAS) in University Students.

This study developed the Brief Math Anxiety Scale (BMAS), a brief version of the Shortened Math Anxiety Rating Scale (sMARS), maintaining its original three-factor structure, by applying item response theory. The sMARS was administered to 1,349 undergraduates, along with other questionnaires to measure their math ability, trait and test anxieties, and attitudes toward mathematics. Results showed that the original scale could be reduced to nine items (three for each subscale). We provided evidence of good psychometric properties: strong internal consistency, adequate 7-week test-retest reliability, and good convergent/discriminant validity. In conclusion, the BMAS provides valid interpretations and reliable scores for assessing math anxiety in university students, and is especially useful in situations with time constraints where the longer form is impractical.

Psychometric Evaluation of the Affective Reactivity Index Among Children and Adolescents in China: A Multi-Method Assessment Approach.

The Affective Reactivity Index (ARI) is one of the most studied scales for assessing youth irritability, but little is known about its measurement performance in community populations. This study applied item response theory (IRT), network analysis, and classical test theory (CTT) to examine the psychometric properties of the ARI in a sample of n = 395 community-based children (Mage = 13.44, SD = 2.51) and n = 403 parents. In this sample, the ARI demonstrated good reliability, as well as convergent and concurrent validity. The one-factor structure was supported by both confirmatory factor analysis (CFA) and network analysis. IRT analysis revealed that the ARI effectively distinguished between various levels of irritability within the community population. Network analysis identified "Loses temper easily,""Gets angry frequently," and "Often loses temper" are central aspects of irritability. The findings support the ARI as a brief, reliable, and valid instrument to assess irritability in community children and adolescents.

Application of Item Response Theory as a Modern Statistical Tool to Test Item Development and Analysis

In the educational and psychological testing, there are two major theories through which tests can be developed, validated and ultimately used for assessing examinee’s performance. These are classical test theory (CTT) and item response theory (IRT) and their corresponding models. Item Response Theory (IRT) as a test theory came into existence to provide probabilistic approach to surmount some of the inherent limitations of the classical test theory and maximize objectivity in educational assessment. Item response theory (IRT) is a quantitative approach to testing the reliability and validity of an instrument based on its items. It has statistics for evaluating individual items from a quantitative perspective. The purpose of this paper is to describe in details, the application of item response theory in test item development and analysis. The reason for the application of IRT is to have test items that will yield a reasonable degree of reliability. The statistics used in this respect are – item difficulty parameter, which is a measure of the proportion of testees who responded to an item correctly; the item discrimination parameter, which is the measure of how well the items discriminate between examinees with high and low levels of knowledge or ability and pseudo-guessing parameter, which expresses the probability that an examinee with low ability can be able to get an item correctly. The acceptable range of values of the aforementioned parameters were also discussed.

문항반응이론을 적용한 KCYPS 창의적 성격 문항의 타당화 연구

This study aimed to examine whether the creative personality items of KCYPS 2018, adapted from Gough & Heilbrun’s (1983) Creative Personality Scale (CPS) reliably and validly measure the creative personality of middle school students. Applying item response theory to the creative personality items, it was found that five items, namely ‘snobbish, unconventional, individualistic, informal, reflective,’ demonstrated very high difficulty, while six items such as ‘unconventional, humorous, individualistic, informal, interests wide, reflective’ showed very low item discrimination. In addition, the analysis of DIF(Differential item function) of gender revealed that the item ‘sexy’ was more favorable for female students, while four items ‘capable, clever, insightful, inventive’ were more advantageous for male students. This indicated that, even with the same level of creative personality, it can be measured differently depending on gender. This study holds significance in rigorously validating the KCYPS 2018 creative personality items through item response theory. We finally highlighted the need for comprehensive development of creative personality scales considering factors such as age, sub-components of creativity, and response patterns.

Psychometric sensitivity analyses can identify bias related to measurement properties in trials that use patient-reported outcome measures: a secondary analysis of a clinical trial using the disabilities of the arm, shoulder, and hand questionnaire

ObjectivesDemonstrate psychometric sensitivity analyses for testing the stability of study findings to assumptions made about patient-reported outcome measures. Study Design and SettingWe performed secondary analyses of Disability of Arm, Shoulder, and Hand (DASH) data collected within the Prevention of Shoulder Problems clinical trial, which compared upper limb function scores in women who had undergone breast cancer surgery, randomized to either an exercise program or usual care. We repeated the principal trial analyses after grouping DASH items into subscales suggested by factorial analyses in this dataset and applied item response theory to account for unequal item weighting. We checked for measurement invariance by participant age and response shift bias using established techniques. ResultsOur analyses suggested that the DASH measured two constructs: motor function and sensory symptoms. The majority of the six-month difference in DASH score was driven by motor function. With item response theory scoring, we found differences in both constructs at 12 months (P = 0.019 and P = 0.007), but in neither construct at 6 months, contrary to the original trial results. We found no differential item function by age or between baseline and 12-month measurements. ConclusionsPsychometric sensitivity analyses aid in the interpretation of the Prevention of Shoulder Problems trial’s results.

Staff-rated ability to provide post-diagnosis support for patients with mild cognitive impairment and related factors.

Proactive interventions for patients with mild cognitive impairment (MCI) are required. We aimed to determine the staff-rated ability to provide post-diagnosis support for patients with MCI at a medical centre for dementia and the related factors. We conducted a web-based survey on post-diagnosis support for patients with MCI among healthcare personnel, such as mental health social workers and public health nurses (hereafter referred to as 'staff'), in consultation and support roles at medical centres for dementia nationwide. The latent characteristic value for 'staff's self-rated ability to provide post-diagnosis support to patients with MCI', which was estimated using the one-parameter logistic model of item response theory, was used as the dependent variable. Multivariate linear regression analysis was used to examine the factors associated with the dependent variable. We conducted the study at 482 medical centres for dementia. We received responses from 162 participants, 158 of which were valid. We applied item response theory to 45 staff-rated items regarding post-diagnosis support for patients with MCI and found that item difficulty ranged from -2.56 to 1.02; 40 items had negative values and were deemed relatively easy. The staff-rated ability to provide post-diagnosis support was significantly higher for 'The role in assisting patients with MCI is clear' (P < 0.005), 'A reasonable number of personnel is available to assist immediately after MCI diagnosis' (P = 0.001), and 'Collaboration with family physician available immediately after MCI diagnosis' (P < 0.001). The results of this study showed that staff rated their ability to provide post-diagnosis support for patients with MCI as relatively easy. The staff-rated ability to provide post-diagnosis support to patients with MCI may be enhanced by increased availability of staff immediately after MCI diagnosis, clarification of staff roles, and collaboration with family doctors.

ITEM RESPONSE THEORY VALIDATION OF THE FORGOTTEN JOINT SCORE FOR PEOPLE UNDERGOING TOTAL KNEE ARTHROPLASTY

AbstractBackgroundThe Forgotten Joint Score (FJS) is a 12-item patient reported outcome measurement instrument. It was developed with classical test theory, without testing assumptions such as unidimensionality (all items reflect one underlying factor), appropriate weighting of each item, no differential item function (DIF, different groups answer the same way), and monotonicity (people with higher function have higher score). We applied item response theory (IRT) to improve the validity of FJS to contemporary standards to optimise it for ongoing use.Research QuestionsDoes the FJS reflect one latent trait? Can an IRT model be fitted to the FJS to provide interval-scaled measurement?MethodologyParticipants undergoing primary total knee replacement provided pre-operative and post-operative (6-months) responses for FJS. An exploratory factor analysis (EFA), confirmatory factor analysis (CFA) and Mokken analysis were conducted. The data were fitted to a graded response model (GRM).Results1288 response patterns were analysed. EFA showed a one factor model (all 12 items load to one underlying trait). CFA demonstrated excellent model fit (X2 &lt;0.001, Tucker Lewis Index=0.96, Comparative Fit Index=0.96). Items did not have equal weighting. The FJS demonstrated good monotonicity with no differential item functioning by sex, age, or body mass index.ConclusionsThe FJS meets key validity assumptions supporting its use in clinical practice and research. The IRT-adapted FJS provides continuous measurements with greater granularity including individual measurement error. This adapted score has advantages over traditional FJS scoring, being interval scaled (using GRM) and can be retrospectively applied to existing response sets.

Caregiver Perceived Stress and Child Sleep Health: An Item-Level Individual Participant Data Meta-Analysis.

Up to 50% of children and adolescents in the United States (U.S.) experience sleep problems. While existing research suggests that perceived stress in caregivers is associated with poorer sleep outcomes in children, research on this relationship is often limited to infant and early childhood populations; therefore, we investigated this association in school-age children and adolescents. We used cross-sectional caregiver-reported surveys and applied item response theory (IRT) followed by meta-analysis to assess the relationship between caregiver perceived stress and child sleep disturbance, and moderation of this relationship by child age and the presence of a child mental or physical health condition. We analyzed data from the National Institutes of Health (NIH) Environmental influences on Child Health Outcomes (ECHO) Program, a collaboration of existing pediatric longitudinal cohort studies that collectively contribute a diverse and large sample size ideal for addressing questions related to children's health and consolidating results across population studies. Participants included caregivers of children ages 8 to 16 years from four ECHO cohorts. Caregiver perceived stress was measured using the Perceived Stress Scale (PSS), and child sleep disturbance was assessed using five sleep-related items from the School-Age version of the Child Behavior Checklist (CBCL). Increases in caregiver perceived stress and child mental or physical health condition were independently associated with greater sleep disturbance among children. The findings reinforce the importance of accounting for, and potentially intervening on, the broader family context and children's mental and physical health in the interest of improving sleep health.

An evaluation and shortening of the Cooking and Food Provisioning Action Scale (CAFPAS) using item response theory

The Cooking and Food Provisioning Action Scale (CAFPAS) is a 28-item validated tool for measuring food agency, a latent construct representing an individual’s ability to make and achieve food-preparation and -provisioning goals. Here, key measurement parameters (targeting, threshold ordering, item fit, unidimensionality, differential item functioning, local dependency, and person reliability) of the CAFPAS are evaluated using a specific case of item response theory, Rasch analysis, on data from a development sample (N = 1853; 910 from Sweden; 943 from the US). Winsteps (v.5.1.7) is used for this analysis. The similarity of the Swedish version of the CAFPAS to the original is also assessed. Based on an iterative assessment of the measurement properties with different combinations of items in the development sample, ways to shorten the CAFPAS without jeopardizing construct validity or person reliability are examined. After removing items that do not fit the Rasch model, or that appear redundant in relation to other items, an 11-item version (CAFPAS-short) is suggested and tested using further Rasch analysis on both the development sample and an additional US-based validation sample (N = 1457). Scores of cooking confidence and attitudes are then modelled with measures from the CAFPAS and CAFPAS-short using frequentist and Bayesian analysis. Results suggest that the CAFPAS-short performs similarly to the full-length version, and potential future improvements to the CAFPAS are discussed. This study represents a successful application of item response theory to investigate and shorten a psychometric scale, reducing cognitive load on participants in studies using the CAFPAS whilst minimizing loss of data reliability.

Phthalate mixtures and insulin resistance: an item response theory approach to quantify exposure burden to phthalate mixtures.

Molar sums are often used to quantify total phthalate exposure, but they do not capture patterns of exposure to multiple phthalates. To introduce an exposure burden score method for quantifying exposure to phthalate metabolites and examine the association between phthalate burden scores and Homeostatic Model Assessment for Insulin Resistance (HOMA-IR). We applied item response theory (IRT) to data from 3474 adults aged 20-60 years in the 2013-2018 National Health and Examination Survey (NHANES) to quantify latent phthalate exposure burden from 12 phthalate metabolites. We compared model fits of three IRT models that used different a priori groupings (general phthalate burden; low molecular weight (LMW) and high molecular weight (HMW) burdens; and LMW, HMW and DEHP burden), and used the best fitting model to estimate phthalate exposure burden scores. Regression models assessed the covariate-adjusted association between phthalate burden scores and HOMA-IR. We compared findings to those using molar sums. In secondary analyses, we examined how the IRT model could be used for data harmonization when a subset of participants are missing some phthalate metabolites, and accounted for measurement error of the phthalate burden scores in estimating associations with HOMA-IR through a resampling approach using plausible value imputation. A three correlated factors model (LMW, HMW and DEHPburdens) provided the best fit. One interquartile range (IQR) increase in DEHP burden score was associated with 0.094 (95% CI: 0.022, 0.164, p = 0.010) increase in log HOMA-IR, co-adjusted for LMW and HMW burden scores. Findings were consistent when using log molar sums. Associations of phthalate burden and insulin resistance were also consistent when participants were simulated to be missing some phthalate metabolites, and when we accounted for measurementerror in estimating burden scores. Both phthalate molar sums and burden scores are sensitive to associations with insulin resistance. Phthalate burden scores may be useful for data harmonization.

Item response theory may account for unequal item weighting and individual-level measurement error in trials that use PROMs: a psychometric sensitivity analysis of the TOPKAT trial

ObjectivesTo apply item response theory as a framework for studying measurement error in superiority trials which use patient-reported outcome measures (PROMs). MethodsWe reanalyzed data from the The Total or Partial Knee Arthroplasty Trial, which compared the Oxford Knee Score (OKS) responses of patients undergoing partial or total knee replacement, using traditional sum-scoring, after accounting for OKS item characteristics with expected a posteriori (EAP) scoring, and after accounting for individual-level measurement error with plausible value imputation (PVI). We compared the marginalized mean scores of each group at baseline, 2 months, and yearly for 5 years. We used registry data to estimate the minimal important difference (MID) of OKS scores with sum-scoring and EAP scoring. ResultsWith sum-scoring, we found statistically significant differences in mean OKS score at 2 months (P = 0.030) and 1 year (P = 0.030). EAP scores produced slightly different results, with statistically significant differences at 1 year (P = 0.041) and 3 years (P = 0.043). With PVI, there were no statistically significant differences. ConclusionPsychometric sensitivity analyses can be readily performed for superiority trials using PROMs and may aid the interpretation of results.

Applying Item Response Theory to the Student Adaptation to College Questionnaire: Examining Psychometric Characteristics and Developing Computerized Adaptive Testing Version

Incoming students have many difficulties adjusting to college, and selecting appropriate measures to effectively screen them is indispensable, especially in China, where there is insufficient research in this area. To enrich domestic research, this study seeks to examine psychometric characteristics and develop a computerized adaptive version of the Student Adaptation to College Questionnaire (SACQ-CAT) based on a sample of Chinese students. Under the framework of item response theory, the item bank of student adaptation to college was formulated after uni-dimensionality testing, model comparison, item fit testing, and local independence testing. Subsequently, a CAT simulation, including three termination rules, was performed using real data to evaluate and verify the SACQ-CAT. The results showed reliability values exceeding 0.90 when participants’ latent traits were between −4 and 3, covering majority of the subjects. The SACQ-CAT administered an average of fewer than 10 items to participants compared to 67 items on the original scale. The correlation coefficient between latency estimated by the SACQ-CAT and the SACQ is greater than .85, whereas the correlation coefficient with the Symptom Checklist 90 (SCL-90) scores ranges from −.33 to −.55 (p < .001). The SACQ-CAT largely reduced the number of items administered to the participants and avoided losing measurement precision.

Assessing social competence and antisocial behaviors in children: item response theory analysis of the home and community social behavior scales

BackgroundThe Home and Community Social Behavior Scales (HCSBS) is a rating scale that assesses social competence and antisocial behavior among children and youths between ages 5–18. The present study aimed to investigate the psychometric properties of the HCSBS by applying item response theory (IRT).MethodsThe HCSBS was completed by parents of 551 Norwegian children refereed to three independent interventions towards problem behaviors. Data used in this study was collected before the interventions started. IRT was carried out in R version 4.0.0 to investigate HCSBS items, subscales and main scales.ResultsThe results showed that the two-dimensional IRT models for social competence and antisocial behavior were the most appropriate. The measurement precision of the scales was high for a large range of the latent spectrum, and estimated reliabilities were satisfactory. Model evaluations indicated that the overall model fit for the scales were acceptable, but some misfit existed with respect to specific item pairs.ConclusionThe results indicate that the HCSBS is a reliable measurement instrument although there is still a potential for improvement by revising some of the items.