Item Characteristic Curves Research Articles

Psychometric Properties of Different Short Forms of Social Interaction Anxiety Scale in Chinese College Students.

There exist four short forms of the Social Interaction Anxiety Scale (SIAS): 10-item version (SIAS-10), 6-item version by Peters et al (SIAS-6P), 6-item version by Fergus et al (SIAS-6F), and 5-item version (SIAS-5). This study aims to comprehensively examine the psychometric properties of the SIAS-10, SIAS-6P, SIAS-6F, and SIAS-5 and to determine which one performs relatively better in Chinese population. This study enrolled 733 Chinese college students. The unidimensionality of the SIAS-10, SIAS-6P, SIAS-6F, SIAS-5 was examined using Confirmatory Factor Analysis (CFA). Multi-Group CFA was further adopted to assess measurement equivalence across gender. Internal consistency reliability and criteria-related validity were also evaluated. Additionally, the measurement performance of the SIAS-10, SIAS-6P, SIAS-6F, and SIAS-5 was assessed with Item Response Theory (IRT), which estimated the discrimination parameter and the Item Characteristic Curve (ICC) for each item. Except for the SIAS-5, the SIAS-10, SIAS-6P, and SIAS-6F displayed a good-fit to the one-factor model. Furthermore, the SIAS-10 achieved strict equivalence across gender while other versions did not. The SIAS-10, SIAS-6P, SIAS-6F and SIAS-5 all had acceptable internal consistency and significant correlations with criteria scales. The IRT results showed that the SIAS-10 included more items with higher discrimination and peaked ICCs (indicating more informative), whereas the SIAS-6P included more items with lower discrimination and flat ICCs (indicating less informative). For assessing social anxiety in Chinese under constrained conditions, the SIAS-10 is recommended to clinicians for it measuring equivalently across gender, reflecting the relevant criteria variables well, and discriminating various levels of social anxiety sensitively.

Research on Innovative Strategies of Kindergarten-based Specialty Programs under the Concept of Ecological Education

Abstract Ecological education is essential for fostering sustainable development and nurturing an ecologically civilized society. It is imperative to embed ecological principles within the pedagogical framework of early childhood education. This study explores the integration of environmental concepts into kindergarten curricula, adopting a child-centric approach to curriculum development. An innovative strategy for specialized programs in kindergartens is proposed, grounded in ecological education principles. Utilizing item response theory, this strategy evaluates young children’s environmental literacy through item characteristic curves and information functions. Additionally, the effectiveness of the specialized, garden-based curriculum is assessed using clustering algorithms. Research conducted in X and N kindergartens reveals that the average scores for the condition, process, and result quality dimensions are 4.3212, 4.3257, and 4.2717, respectively—all surpassing the threshold of 4. These findings indicate that the specialized programs significantly meet the developmental needs of both children and teachers, effectively enhancing the conditions, processes, and outcomes of ecological education in kindergartens.

Development and psychometric testing of the narrative nursing teaching effectiveness scale: A methodological study

BackgroundNarrative teaching is widely used in nursing education. However, there is currently a lack of valid and reliable tool to assess the effectiveness of narrative nursing teaching from the perspective of nursing students. ObjectivesThis study developed a Narrative Nursing Teaching Effectiveness (NNTE) scale and evaluated its psychometric properties. DesignA methodological design was used to develop and validate the instrument. SettingsThe study took place at a university in southern China. ParticipantsThe study involved 283 nursing students enrolled at a medical university in Fujian Province, China. MethodsThe researchers conducted literature reviews, held focus groups and individual interviews, and utilized the Delphi method to create a pool of indicators for a narrative nursing teaching evaluation system. A pretest was administered to 150 nursing students. Next, the primary study involved 283 nursing students, chosen through cluster sampling, completed a general information questionnaire along with the NNTE scale. Data analysis was performed using SPSS 26.0, Mplus 6.1, and STATA 16.0, and included general statistical analysis, critical test theory, and item response theory analyses. ResultsThe researchers created a 42-item scale with four subdomains, explaining 60.32 % of the total variance. Confirmatory factor analysis proved the four-factor model's validity. Cronbach's alpha values for the four subscales ranged from 0.869 to 0.949. The average content validity index of the scale was 0.923 and the item content validity index ranged from 0.872 to 1. In addition, all item characteristic curves displayed desirable shapes, and the test information functions provided precise information. ConclusionsThe NNTE scale exhibits good psychometric properties, providing a scientifically sound and effective instrument to evaluate the effectiveness of the narrative nursing teaching approach to nursing education.

Use of the Rasch Model for Fit Statistics and Rating Scale Diagnosis for the Student Perception Appraisal.

Background and Purpose: Nursing student retention is essential to meet workforce demands. Jeffreys' Nursing Student Retention Student Perception Appraisal-Revised (SPA-R1) has been used extensively to understand factors that impact retention. Psychometric testing of the SPA-R1 contributes to greater confidence in the instrument's reliability and validity. Methods: Item response theory and specifically, the single parameter polytomous Rasch model was used as a framework for fit statistic testing and rating scale diagnostics of the SPA-R1. This was a secondary analysis of a convenience sample of undergraduate prelicensure nursing students. The setting for the previous study was virtual, and the study period was 2022. Results: The model item characteristic curves for the 27 items of the SPA-R1 have similar shapes and are clustered in proximity. Overall, there are three clusters of items evident in the Rasch standardized residual contrast. The Rasch scale diagnostics indicated that the scale appropriately monotonically increases. However, there is a greater than 5 logit distance between does not apply and severely restricts, between severely restricts and moderately restricts, and between does not restrict or support and moderately supports. These large threshold distances indicate that additional steps in the scale may be warranted. The items cover the mid-range of the amount of retention perceptions; however, there are no items that represent the highest magnitude of the perceived amount of influence on retention. Conclusions: This study contributes further evidence to support the validity and reliability of the SPA-R1. We recommend adding steps to the scale, removing the does not apply response option, and considering scoring by three domains or clusters.

Performance of the Physical Functioning Activities of Daily Living Scale in the 2020 Medicare Health Outcomes Survey

ObjectiveAssessing functional limitations for adults at high risk of frailty yields valuable information for identifying those in need of therapy. We evaluate a self-report measure used to assess physical function among Medicare recipients in the United States. DesignSecondary analysis of the 2020 Medicare Health Outcomes Survey. SettingA random sample of adult enrollees of 510 managed care plans. Participants287,476 adults (37% completion rate): 58% women; 16% were <65 years old (entitled via disability), 50% 65-74, and 34% 75 or older; 77% White, 14% Black, and 8% another race; 19% had <high school education. InterventionsNot applicable. Main Outcome MeasureWe evaluate item distributions, dimensionality, monotonicity of response options, reliability, and validity of the 8-item Physical Functioning Activities of Daily Living (PFADL) scale. ResultsMost reported they could do 6 basic activities of daily living without difficulty. More limitations were reported for the other 2 PFADL items: 32% were not limited at all in climbing several flights of stairs and 40% in moderate activities. Product-moment correlations among the 8 items ranged from r=0.19 between the easiest-to-do (eating) and most difficult-to-do (climbing several flights of stairs) items to r=0.73 between bathing and dressing. The coefficient alpha and omega for the 8-item scale were both 0.86. Item slopes ranged from 2.6 (climbing several flights of stairs and eating) to 4.8 (dressing). Item characteristic curves revealed that response options were most likely to be selected in the appropriate order along the physical functioning continuum. The PFADL had at least 0.80 reliability between about -3 SDs below the mean to the mean. It was negatively correlated with comorbid condition count, disability days, problems with balance or walking, falling, and obesity. ConclusionsThe PFADL is useful for assessing average or below physical function in Medicare recipients.

A complementary approach to measure construct validity of WHO QOL BREF in Indian multidrug-resistant tuberculosis (MDR-TB) patients through psychometric property and factor analysis

Background: Multidrug-resistant tuberculosis (MDR TB) affects the physical, psychosocial and inter-relationship structure and thus quality of life (QoL) of an individual. WHO QOL BREF is presumed to capture the QoL construct. This study investigates the diagnostic accuracy and construct of WHO QOL BREF from a psychometric perspective and complements and converges findings through classical test theory. Methods: The instrument validity study was conducted in a district of Central India amongst the microbiologically confirmed MDR TB cohort of year 2017 (n=98). We calculated global and domain-specific Cronbach alpha and Inter-domain Pearson correlations. The dichotomized items were fitted through Rasch model for item endorsement, response pattern and for variation inconsistencies. Item Characteristic Curves and person item maps were also plotted. We performed DIF (Differential Item Functioning) to check the effect of subgroups on underlying traits. This was complimented with an Exploratory Factor Analysis (EFA) using oblique ProMax rotation. The optimum number of factors were identified by Scree plot and parallel analysis approach and the emerging factor structure was compared with the result obtained through the Rasch model. Results: The global Cronbach’s alpha was 0.94 (95% CI 0.92-0.96). Social relationship domain had poor correlations with all three domains (r=0.42, r=0.41 r=0.58), higher beta values and less discrimination. DIF showed a differential response by gender. There was a visual clustering and a non-uniform distribution of items across the perceived QoL. A 3-factor model emerged through EFA and was reframed on the notion of self-concept. Items related to pain, medical aid had significant misfit and weak factor loading while items of sexual activity and social support had relatively poor performance in Infit, Wald, DIF on factor loading parameters. Conclusions: The study indicates the possible deviation of scale from theorized dimensional construct in Indian MDR TB context more with the items of the social relationship domain.

Reliability testing of the Persian low-vision quality-of-life questionnaire based on Rasch analysis

Objective: Low-vision quality-of-life (LVQOL) questionnaire was recently translated to Persian. Its model fit and construct validity were assessed by exploratory and confirmatory analysis for adults with visual impairment, before. In this study, we aimed to test the reliability of the Persian LVQOL questionnaire based on Rasch analysis. Methods: Overall, 100 low-vision patients and 100 demographic statue-matched control subjects were participated for evaluating reliability aspects. All the participants were asked to complete the Persian LVQOL questionnaire. The low-vision group was asked to fill out the LVQOL 3 months after rehabilitation to determine how rehabilitation changed the quality of life. Rasch analyses of the survey items were conducted using WINSTEPS. Results: All items fitted the Rasch model. Point-measure correlations values varied from .13 to .70, providing a preliminary indication of adequate construct validity. All factor loadings found more than .4. infit values for all other participants were in the acceptable range. All items obtained infit and outfit MSQ values of &lt; 2.0. Patients’ abilities relative to the item difficulty were analyzed. Item difficulty was estimated and item characteristic curves were included. Sufficient unidimensionality, hierarchical order, and equal interval scaring were obtained. Conclusion: The Persian LVQOL questionnaire was reliable enough and it will be valuable in both clinical practice and research.

RMX/PIccc: An Extended Person–Item Map and a Unified IRT Output for eRm, psychotools, ltm, mirt, and TAM

A constituting feature of item response models is that item and person parameters share a latent scale and are therefore comparable. The Person–Item Map is a useful graphical tool to visualize the alignment of the two parameter sets. However, the “classical” variant has some shortcomings, which are overcome by the new RMX package (Rasch models—eXtended). The package provides the RMX::plotPIccc() function, which creates an extended version of the classical PI Map, termed “PIccc”. It juxtaposes the person parameter distribution to various item-related functions, like category and item characteristic curves and category, item, and test information curves. The function supports many item response models and processes the return objects of five major R packages for IRT analysis. It returns the used parameters in a unified form, thus allowing for their further processing. The R package RMX is freely available at osf.io/n9c5r.

A Comparison of Mantel-Haenszel and the Area Difference Between Item Characteristic Curves Index Techniques for Detecting Differential Item Functioning

The study is aimed at comparing between Mantel-Haenszel-MH chi-square and the area difference between three item characteristic curves Index -3ICCs by using Raju’s index to detect the differential item functioning DIF in post-graduate general aptitude test according to gender variable. The study sample of (2280) students was distributed equally between male and female groups. The MH techniques revealed a uniform DIF in (43) items, equal to (45%) of the items in post-graduate general aptitude test. 3ICCs technique, revealed a uniform DIF based on gender in two items, equals to (2%) of item's test. MH technique revealed more efficiency in detecting differential item functioning in post-graduate general aptitude test compared to area difference between 3ICCs. The agreement rate was low between these two techniques. Based on these results, the researchers recommended to use more than one technique when detecting the differential item functioning. Keywords: Differential Item Functioning, Mantel-Haenszel, The three-parameter logistic model, post-graduate general aptitude test.

Exploration and analysis of a generalized one-parameter item response model with flexible link functions.

This paper primarily analyzes the one-parameter generalized logistic (1PGlogit) model, which is a generalized model containing other one-parameter item response theory (IRT) models. The essence of the 1PGlogit model is the introduction of a generalized link function that includes the probit, logit, and complementary log-log functions. By transforming different parameters, the 1PGlogit model can flexibly adjust the speed at which the item characteristic curve (ICC) approaches the upper and lower asymptote, breaking the previous constraints in one-parameter IRT models where the ICC curves were either all symmetric or all asymmetric. This allows for a more flexible way to fit data and achieve better fitting performance. We present three simulation studies, specifically designed to validate the accuracy of parameter estimation for a variety of one-parameter IRT models using the Stan program, illustrate the advantages of the 1PGlogit model over other one-parameter IRT models from a model fitting perspective, and demonstrate the effective fit of the 1PGlogit model with the three-parameter logistic (3PL) and four-parameter logistic (4PL) models. Finally, we demonstrate the good fitting performance of the 1PGlogit model through an analysis of real data.

The Italian Family Satisfaction in the Intensive Care Unit Questionnaire: A Psychometric Evaluation Using the Rasch Model.

Quality measurement of the intensive care unit (ICU) should include families' perspectives, their satisfaction with the care process and outcomes, and the evaluation of actions to improve their psychological health and wellbeing. The current study was designed to validate the Italian version of the Family Satisfaction in the Intensive Care Unit (FS-ICU) using the Rasch model. Results included reliability and separation for items and persons, item fit statistics, unidimensionality, and item characteristic curve. The study was conducted between August 2022 and February 2023. A total of 108 family members (mean age 54.9 years) completed the FS-ICU questionnaire. The instrument had a moderate discrimination ability and only five items (#21, #23, #10, #22, and #24) exhibited a misfit. The Rasch dimension explained 52.1% of the variance in the data, while the unexplained variance in the first contrast is 7.2%, which indicates a possible second dimension. FS-ICU was shown to be beneficial as an assessment instrument for family member satisfaction in the ICU, despite some flaws that need to further be addressed to improve the scale.

Measuring skill-based health literacy in chronic airway disease patients: the development and psychometric evaluation of the Vancouver airways health literacy tool (VAHLT).

This article describes the development of the Vancouver airways health literacy tool (VAHLT), a novel measure of skill-based health literacy specific to chronic airway diseases (CADs). Across several phases, psychometric characteristics of the VAHLT were examined and used to guide its development. An initial pool of 46 items was developed using input from patients, clinicians, researchers, and policy-makers. An initial patient sample (N = 532) was evaluated and used to inform item revisions. A revised 44-item pool was then evaluated using a second sample, the results of which aided in the selection of a final set of 30 items. The finalized 30-item VAHLT was then psychometrically evaluated using the second sample (N = 318). An item response theory approach was utilized to evaluate the VAHLT by assessing model fit, item parameter estimates, test and item information curves, and item characteristic curves. Reliability was assessed using ordinal coefficient alpha. We additionally assessed differential item functioning between asthma and COPD diagnoses. The VAHLT demonstrated a unidimensional structure and reasonably discriminated patients in the lower range of health literacy estimates. The tool demonstrated strong reliability (α = .920). Two of the 30 items were found to exhibit non-negligible differential item functioning. This study presents compelling evidence of validity in several areas for the VAHLT, including content and structural validity. Further external validation studies are needed and forthcoming. Overall, this work represents a strong first step towards a novel, skill-based, and disease-specific measure of CAD-related health literacy.

Alternatives to Weighted Item Fit Statistics for Establishing Measurement Invariance in Many Groups

Evaluating scale comparability in international large-scale assessments depends on measurement invariance (MI). The root mean square deviation (RMSD) is a standard method for establishing MI in several programs, such as the Programme for International Student Assessment and the Programme for the International Assessment of Adult Competencies. Previous research showed that the RMSD was unable to detect departures from MI when the latent trait distribution was far from item difficulty. In this study, we developed three alternative approaches to the original RMSD: equal, item information, and b-norm weighted RMSDs. Specifically, we considered the item-centered normalized weight distributions to compute the item characteristic curve difference in the RMSD procedure more efficiently. We further compared all methods’ performance via a simulation study and the item information and b-norm weighted RMSDs showed the most promising results. An empirical example is demonstrated, and implications for researchers are discussed.

Psychometric properties and general population reference values for PROMIS Global Health in Hungary

ObjectivesPatient-Reported Outcomes Measurement Information System–Global Health (PROMIS-GH) is a widely used generic measure of health status. This study aimed to (1) assess the psychometric properties of the Hungarian PROMIS-GH and to (2) develop general population reference values in Hungary.MethodsAn online cross-sectional survey was conducted among the Hungarian adult general population (n = 1700). Respondents completed the PROMIS-GH v1.2. Unidimensionality (confirmatory factor analysis and bifactor model), local independence, monotonicity (Mokken scaling), graded response model fit, item characteristic curves and measurement invariance were examined. Spearman’s correlations were used to analyse convergent validity of PROMIS-GH subscales with SF-36v1 composites and subscales. Age- and gender-weighted T-scores were computed for the Global Physical Health (GPH) and Global Mental Health (GMH) subscales using the US item calibrations.ResultsThe item response theory assumptions of unidimensionality, local independence and monotonicity were met for both subscales. The graded response model showed acceptable fit indices for both subscales. No differential item functioning was detected for any sociodemographic characteristics. GMH T-scores showed a strong correlation with SF-36 mental health composite score (rs = 0.71) and GPH T-scores with SF-36 physical health composite score (rs = 0.83). Mean GPH and GMH T-scores of females were lower (47.8 and 46.4) compared to males (50.5 and 49.3) (p < 0.001), and both mean GPH and GMH T-scores decreased with age, suggesting worse health status (p < 0.05).ConclusionThis study established the validity and developed general population reference values for the PROMIS-GH in Hungary. Population reference values facilitate the interpretation of patients’ scores and allow inter-country comparisons.

Hyperhidrosis quality of life index (HidroQoL): further validation by applying classical test theory and item response theory using data from a phase III clinical trial

BackgroundThe Hyperhidrosis Quality of Life Index (HidroQoL ©) is a well-developed and validated patient-reported outcome measure assessing the quality-of-life impacts in hyperhidrosis with 18 items. Our aim was to extend the already existing validity evidence for the HidroQoL, especially in relation to structural validity. Especially Rasch analysis has not been applied to the final 18-item HidroQoL before.MethodsData from a phase III clinical trial were used. Confirmatory factor analysis was conducted to confirm the two a priori HidroQoL scales within classical test theory. Furthermore, the assumptions of the Rasch model (model fit, monotonicity, unidimensionality, local independence) and Differential Item Functioning (DIF) were assessed using item response theory.ResultsThe sample included 529 patients with severe primary axillary hyperhidrosis. The two-factor structure could be confirmed by the confirmatory factor analysis (SRMR = 0.058). The item characteristic curves showed mainly optimally functioning response categories, indicating monotonicity. The overall fit to the Rasch model was adequate and unidimensionality for the HidroQoL overall scale could be confirmed, since the first factor had an eigenvalue of 2.244 and accounted for 18.7%. Local independence was below assumed thresholds (residual correlations ≤ 0.26). DIF analysis, controlling for age or gender, was critical for four and three items, respectively. However, this DIF could be explained.ConclusionUsing classical test theory and item response theory/Rasch analyses, this study provided further evidence for the structural validity of the HidroQoL. This study confirmed several specific (measurement) properties of the HidroQoL questionnaire in patients with physician-confirmed severe primary axillary hyperhidrosis: the HidroQoL is a unidimensional scale allowing the summation of scores to generate a single score, and simultaneously it has a dual structure, also allowing the calculation of separate domain scores for daily activities and psychosocial impacts. With this study, we provided new evidence of the structural validity of the HidroQoL in the context of a clinical trial.Trial registration The study was registered (ClinicalTrials.gov identifier: NCT03658616, 05 September 2018, https://clinicaltrials.gov/ct2/show/NCT03658616?term=NCT03658616&draw=2&rank=1).

Development of a Chinese version of the Stress Adaption Scale and the assessment of its reliability and validity among Chinese patients with multimorbidity.

To develop a Chinese version of the Stress Adaption Scale (SAS) and to assess its reliability and validity among Chinese patients with multimorbidity. The Brislin model was used to translate, synthesize, back-translate, and cross culturally adapt the SAS. A total of 323 multimorbidity patients selected by convenience sampling method from four hospitals in Zhejiang province. The critical ratio method, total question correlation method, and graded response model (item characteristic curve and item discrimination) were used for item analysis. Cronbach's alpha coefficient and split-half reliability were used for the reliability analysis. Content validity analysis, structural validity analysis, and criterion association validity analysis were performed by expert scoring method, confirmatory factor analysis, and Pearson correlation coefficient method, respectively. The Chinese version of the SAS contained 2 dimensions of resilience and thriving, with a total of 10 items. In the item analysis, the critical ratio method showed that the critical ratio of all items was greater than 3.0 (P<0.001); the correlation coefficient method showed that the Pearson correlation coefficients for all items exceeded 0.4 (P<0.01). The graded response model showed that items of the revised scale exhibited distinct item characteristic curves and all items had discrimination parameters exceeding 1.0. In the reliability analysis, Cronbach's alpha coefficient of the revised Chinese version of the SAS scale was 0.849, and the split-half reliability was 0.873. In the validity analysis, the item-level content validity index and scale-level content validity index both exceeded 0.80. In the confirmatory factor analysis, the revised two-factor model showed satisfactory fit indices (χ2/df=3.115, RMSEA=0.081, RMR=0.046, GFI=0.937, AGFI=0.898, CFI=0.936, TLI=0.915). In the criterion-related validity analysis, the Chinese version of the SAS score was negatively correlated with the Perceived Stress Scale and the Treatment Burden Questionnaire, with correlation coefficients of －0.592 and －0.482, respectively (both P<0.01). The Chinese version of the SAS has good reliability and validity, which can be used to evaluate the stress adaption capacity among multimorbidity patients in China, and provides a reference for developing individualized health management measures.

Rasch and Confirmatory Factor Analyses of the Arabic Version of the Psychological Empowerment Scale (PsyES): A Multicultural Approach for Measurable Sustainability

This research is focused on the well-known notion of workplace motivation known as psychological empowerment and how this may be used regarding sustainability. This research aimed to use Rasch and confirmatory factor analyses to examine the multidimensionality, reliability, and model fit of the Arabic version of the psychological empowerment scale (PsyES). A total of 579 male and female employees participated in this study. The participants were from the Jazan region, Saudi Arabia. PsyES’s four constructs (meaning, competence, self-determination, and impact) and their dimensionalities were confirmed using Rasch and AMOS analyses. A total of 323 women (55.8%) and 256 men (44.2%) provided data. Most respondents were married (74.8%), followed by those who were never married (21.1%), divorced (3.1%), and widowed (1.0%). The final multidimensional scale model adequately fits the data (chi-square/df (cmin/df) = 3.55, comparative fit index = 0.97, root mean square error of approximation = 0.066, and standardized RMR = 0.035) according to the AMOS results. This multidimensional nature of PsyES was further confirmed using the Rasch model. The person and item separation indices were more than 1.5, and the Rasch analysis revealed 39 persons with a misfit. The modified rating scale’s functioning was confirmed by the item characteristic curve. The MnSq and Zstd values did not deviate from the two recognized limits or indicate that the data were consistent with the Rasch model based on the recommended indicators. This is the first study of its kind to find PsyES useful as a screening tool for psychological empowerment in its Arabic version. Its four dimensions are a valid and reliable measurement tool that can be used in many measurable areas of sustainability.

Revisiting the Samejima–Bolfarine–Bazán IRT models: New features and extensions

In 2010, the Samejima–Bolfarine–Bazán (SBB) Item Response Theory (IRT) models were introduced by (Journal of Educational and Behavioral Statistics 35 (2010) 693–713) under a Bayesian approach. These models extend the regular Bayesian One and Two Parameter Logistic IRT models by incorporating a parameter accounting for asymmetry of the Item Characteristic Curve (ICC) which is named the complexity of the item. It includes the Logistic Positive Exponent (LPE) IRT model formulated initially by (Psychometrika 65 (2000) 319–335) and the Reflection of the LPE (RLPE). In the present work, new properties of the SBB models are developed including a random effect for testlet structures with a Bayesian inference through a Markov chain Monte Carlo (MCMC) algorithm which includes the parameter estimation and model comparison. The asymmetric behavior of the Item Characteristic Curve (ICC) is detected using a marginal item information function. Two simulation studies are developed to analyze the sensitiveness of the penalized parameter in the asymmetric behavior of the ICC and to evaluate the parameter recovery of the proposed model. A real data set, with a testlet structure and empirical evidence of asymmetric behavior of the ICCs, is used to apply the models.

Assessing ChatGPT's Capability for Multiple Choice Questions Using RaschOnline: Observational Study.

ChatGPT (OpenAI), a state-of-the-art large language model, has exhibited remarkable performance in various specialized applications. Despite the growing popularity and efficacy of artificial intelligence, there is a scarcity of studies that assess ChatGPT's competence in addressing multiple-choice questions (MCQs) using KIDMAP of Rasch analysis-a website tool used to evaluate ChatGPT's performance in MCQ answering. This study aims to (1) showcase the utility of the website (Rasch analysis, specifically RaschOnline), and (2) determine the grade achieved by ChatGPT when compared to a normal sample. The capability of ChatGPT was evaluated using 10 items from the English tests conducted for Taiwan college entrance examinations in 2023. Under a Rasch model, 300 simulated students with normal distributions were simulated to compete with ChatGPT's responses. RaschOnline was used to generate 5 visual presentations, including item difficulties, differential item functioning, item characteristic curve, Wright map, and KIDMAP, to address the research objectives. The findings revealed the following: (1) the difficulty of the 10 items increased in a monotonous pattern from easier to harder, represented by logits (-2.43, -1.78, -1.48, -0.64, -0.1, 0.33, 0.59, 1.34, 1.7, and 2.47); (2) evidence of differential item functioning was observed between gender groups for item 5 (P=.04); (3) item 5 displayed a good fit to the Rasch model (P=.61); (4) all items demonstrated a satisfactory fit to the Rasch model, indicated by Infit mean square errors below the threshold of 1.5; (5) no significant difference was found in the measures obtained between gender groups (P=.83); (6) a significant difference was observed among ability grades (P<.001); and (7) ChatGPT's capability was graded as A, surpassing grades B to E. By using RaschOnline, this study provides evidence that ChatGPT possesses the ability to achieve a grade A when compared to a normal sample. It exhibits excellent proficiency in answering MCQs from the English tests conducted in 2023 for the Taiwan college entrance examinations.

Psychometric Properties of the Chinese Warwick-Edinburgh Mental Well-being Scale in Medical Staff: Cross-sectional Study.

Worldwide, mental well-being is a critical issue for public health, especially among medical staff; it affects professionalism, efficiency, quality of care delivery, and overall quality of life. Nevertheless, assessing mental well-being is a complex problem. This study aimed to evaluate the psychometric properties of the Chinese-language version of the 14-item Warwick-Edinburgh Mental Well-being Scale (WEMWBS) in medical staff recruited mainly from 6 hospitals in China and provide a reliable measurement of positive mental well-being. A cross-sectional online survey was conducted of medical staff from 15 provinces in China from May 15 to July 15, 2020. Confirmatory factor analysis (CFA) was conducted to test the structure of the Chinese WEMWBS. The Spearman correlations of the Chinese WEMWBS with the 5-item World Health Organization Well-Being Index (WHO-5) were used to evaluate convergent validity. The Cronbach α and split-half reliability (λ) represented internal consistency. A graded response model was adopted for an item response theory (IRT) analysis. We report discrimination, difficulty, item characteristic curves (ICCs), and item information curves (IICs). ICCs and IICs were used to estimate reliability and validity based on the IRT analysis. A total of 572 participants from 15 provinces in China finished the Chinese WEMWBS. The CFA showed that the 1D model was satisfactory and internal consistency reliability was excellent, with α=.965 and λ=0.947, while the item-scale correlation coefficients ranged from r=0.727 to r=0.900. The correlation coefficient between the Chinese WEMWBS and the WHO-5 was significant, at r=0.746. The average variance extraction value was 0.656, and the composite reliability value was 0.964, with good aggregation validity. The discrimination of the Chinese WEMWBS items ranged from 2.026 to 5.098. The ICCs illustrated that the orders of the category thresholds for the 14 items were satisfactory. The Chinese WEMWBS showed good psychometric properties and can measure well-being in medical staff.