Test Item Response Research Articles

Translating and validating the Ghosting Questionnaire into Arabic: results from classical test theory and item response theory analyses

BackgroundGhosting refers to the sudden cessation of communication in interpersonal relationships. Ghosting has gained attention as a phenomenon commonly encountered in the context of digital communication. Earlier studies on ghosting mostly focused on Western societies while, in Arab societies, research into this practice has yet to be initiated. The current study aimed to address this gap by translating and validating the commonly used Ghosting Questionnaire (GHOST) into Arabic.MethodsThe translation process involved forward and back translation, expert review, and pilot testing to ensure linguistic and cultural equivalence. A convenience sample of 607 participants from Bahrain, Egypt, Jordan, Oman, and Tunisia completed the Arabic version of the GHOST. Statistical analyses, including reliability testing and confirmatory factor analysis, were conducted to assess the psychometric properties of the instrument.ResultsThe Arabic version of the GHOST demonstrated high reliability. The Cronbach’s alpha (α = 0.87) and McDonald’s omega (ω = 0.87) coefficients indicated strong internal consistency. Test-retest reliability coefficients confirmed the stability of the responses over time (ICC 0.89, p < 0.001). CFA supported a single-factor structure in alignment with the conceptual framework of the original English version.ConclusionsThe successful translation and validation of the GHOST into Arabic provide researchers with a reliable tool for investigating ghosting behavior within Arab societies. Future research endeavors can build upon these findings to explore the psychological implications of ghosting. Researchers can now also develop culturally sensitive understanding of online dating and related practices in Arab communities.

The translation and validation of the surgical anxiety questionnaire into the modern standard Arabic language: results from classical test theory and item response theory analyses

BackgroundPreoperative anxiety is commonly found in patients who are waiting for surgery and can lead to negative surgical outcomes. Understanding the sources of surgical anxiety allows healthcare providers to identify at-risk patients and implement psychosocial interventions such as counseling, relaxation techniques, and cognitive‒behavioral therapy to minimize anxiety. Few comprehensive psychiatric measures are available to assess preoperative anxiety in Arabic.ObjectiveOur study aimed to translate, adapt, and validate the Surgical Anxiety Questionnaire (SAQ) into the modern standard Arabic language, also known as Fusha al-Asr Arabic.MethodsTo translate the questionnaire, the research team used the gold standard process of forward translation by two independent translators along with back translation evaluation by four trained medical doctors. A cross-sectional study was conducted using an online survey completed by 208 Arabic speakers (mean age 38 years, 44% women) from four countries. Psychometric analyses, which included internal consistency, test-retest reliability, convergent validity, confirmatory factor analysis, and item response analysis, were performed. Convergent validity tests were performed against the Generalized Anxiety Disorder 2-item Scale (GAD-2), Patient Health Questionnaire-4 (PHQ-2), Perceived Stress Scale 4 (PSS-4), and Arabic version of the Visual Analog Scale for anxiety (VAS-A).ResultsThe mean SAQ of our sample was 19.38 ± 12.63 (possible range 0–68). The Arabic SAQ translation demonstrated excellent internal consistency, with McDonald’s omega and a Cronbach’s alpha of approximately 0.90. The test-retest reliability was also high, with an intraclass coefficient of 0.94. The SAQ showed strong convergent validity against the GAD-2 (r = 0.94, p < 0.01). The SAQ also showed weak-moderate correlations with the PHQ-2 (r = 0.26, p < 0.01), PSS-4 (r = 43, p < 0.01), and VAS-A (r = 0.36, p < 0.01) scores. The original three-factor structure was supported by confirmatory factor analysis, confirming the original structure reported in the original English language version. The results for fitness indices showed acceptable preliminary results (CFI/TLI approximately 0.90), and deleting some items improved the model fit (CFI/TLI > 0.90, RMSEA < 0.08). We suggest retaining the original factorial solution until further validation studies can be conducted. The item response theory (IRT) results identified no items that were excessively difficult or subject to guessing. The multidimensional IRT provided evidence that the SAQ items form a multidimensional scale assessing surgical anxiety that fits the classical model reasonably well.ConclusionThe SAQ has demonstrated acceptable reliability and validity; thus, it is a trustworthy and valid tool for evaluating preoperative anxiety in Arabic speakers. Future research could benefit from using the SAQ in both surgical and psychiatric research.

Psychometric evaluation of the study interest questionnaire-short form among Chinese nursing students based on classical test theory and item response theory

BackgroundThere is currently no dedicated measurement for assessing nursing students’ study interest in China. Considering the good reliability, validity, and widespread applicability of the Study Interest Questionnaire-Short Form (SIQ-SF), the objective of this study was to validate its usage among Chinese nursing students.MethodsThe translation and cross-cultural adaptation rigorously followed the modified Brislin model. A cross-sectional survey was conducted using the Chinese version of the SIQ-SF and convenience sampling was employed to select nursing students. The Psychometric evaluation of the Chinese version of the SIQ-SF was conducted based on Classical Test Theory and Item Response Theory.ResultsA total of 1158 participants were included in the analysis. The item-level content validity index (CVI) ranged from 0.9 to 1.0, and the scale-level CVI was 0.98. In the Exploratory factor analysis, three factors with eigenvalues above 1 were identified, accounting for 62.554% of the cumulative variance. In the confirmatory factor analysis, the CMIN\\DF was 5.639, the GFI was 0.953, the CFI was 0.902, and the IFI was 0.904. The Cronbach’s α coefficient of the Chinese version of the SIQ-SF was 0.70. Thirty-one participants were invited to sign the scale after two weeks. The intraclass correlation coefficient was 0.784, and that of items ranged from 0.70 to 0.819. The infit MnSQ values ranged between 0.76 and 1.51, and the outfit MnSQ values ranged between 0.72 and 1.76. The point-measure correlation value ranged between 0.30 and 0.68. The item difficulty measures ranged from − 0.66 to 1.44 logit and the individual learning interest estimations ranged from − 4.22 to 4.97 logit. DIF contrast ranged from 0.00 to 0.33 logits, with all p values greater than 0.05.ConclusionsThe Chinese version of the SIQ-SF demonstrated acceptable reliability and validity among Chinese nursing students and could be used to assess nursing students’ study interest in China. With the aid of this scale, teachers can gain a better understanding of nursing students’ study interests, thereby maximizing their learning effects through appropriate content and methods.

Teachers’ computational thinking content knowledge: Development of a measurement instrument

Computational thinking has become an integral component of curricula worldwide, necessitating teachers to develop this competence in their students. To effectively meet these curricular requirements, teachers themselves need a solid foundation of computational thinking content knowledge, which refers to the understanding and skills they possess in this area. However, despite widespread recognition of this need, few studies have rigorously examined teachers’ content knowledge in this domain. Addressing this gap requires the development of high-quality measurement tools. This study details the development of an instrument, created as part of the International Computer and Information Literacy Study (ICILS) 2023 in Flanders, to measure lower secondary school teachers’ computational thinking content knowledge in a valid and reliable way. The article first outlines the construction process of the instrument, which involved close collaboration with experts in the field and drew upon the framework of Fraillon and colleagues (2023). Following this, the instrument’s psychometric properties are presented, which include both item-level and overall instrument characteristics. These properties were evaluated using data from a sample of 352 participants, applying both Classical Test Theory and Item Response Theory. The final tool consists of 16 multiple-choice and short constructed response questions. The results indicate favorable item and overall instrument characteristics, thereby affirming its potential to measure the intended construct in a valid and accurate way.

Adaptation of a Chinese Version of the Relational Needs Satisfaction Scale Based on Item Response Theory Among Chinese Adults Aged 18-30.

The satisfaction of relational needs is an important indicator of the quality of interpersonal relationships, but few studies on this topic have been conducted in China. The Relational Needs Satisfaction Scale (RNSS) was developed and used in three countries. In this study, the scale was standardized. A total of 2136 Chinese adults aged 18-30 years were recruited to complete the RNSS-Chinese (RNSS-C) and the Satisfaction with Life Scale (SWLS) online, and classical test theory and item response theory (IRT) were used to analyze the psychometric characteristics of the RNSS-C. The measurement invariance of the Chinese and Czech RNSSs was analyzed. (1) The RNSS still has good reliability (Cronbach's alpha = 0.935) and validity (CFI=0.948, TLI=0.940, RMSEA=0.049, and SRMR=0.032) in China. (2) The RNSS-C revealed differences in the perceptions of relational needs construct between the two groups (ΔCFI=0.014>0.01). These findings contribute to a deeper understanding of the cultural factors that shape interpersonal relationships and satisfaction in China.

Chinese version of the Death Anxiety Beliefs and Behaviours Scale: Psychometric properties based on CTT and IRT

ObjectivesThe Death Anxiety Beliefs and Behaviour Scale (DABBS) is a unique tool designed to assess the detrimental beliefs and avoidant behaviors linked to death anxiety. This study aimed to adapt the DABBS into Chinese and verify its psychometric characteristics within a community-dwelling older adult population. MethodsThis study used a cross-sectional design and translated the DABBS into Chinese. The psychometric properties of 437 community-dwelling older persons were assessed using the Classical Test Theory (CTT) and Item Response Theory (IRT). ResultsThe DABBS consisted of affect, beliefs, and behaviours, with 18 entries in 3 dimensions. The I-CVI of the DABBS ranged from 0.857 to 1.000, and the S-CVI was 0.968; Cronbach's alpha of 0.905. Rasch analysis results showed that the 3 dimensions of the scale possessed good unidimensionality, and the entries were well-fitted to the dimensions in which they were located; each entry Infit MNSQ and Outfit MNSQ were in the range of 0.50 to 1.50; the analysis of the functional differences of items in different characteristic subgroups (gender) showed that the absolute value of DIF Contrast was <0.50. The results of the Wright map showed that the ability of the participants was normally distributed, and the difficulty of the scale's entries was adapted to the average ability level of older adults. ConclusionsThe present data indicate that the revised DABBS is a valid and reliable tool for assessing affect, beliefs, and behaviors associated with death anxiety in community-dwelling older individuals.

Psychometric Properties and Factor Structure of the Disgust Scale-Revised (DS-R) for the Romanian population

Research on measuring the intensity of disgust has required the development of instruments to measure this construct. Given that, a more culturally appropriate scale is needed to ensure a valid and reliable measurement of disgust. The concept of “disgust” does not have an appropriate literature in Romanian pathology, and Disgust Scale-Revised (DS-R) is quite rarely used in the public health context. Therefore, this study focuses on the psychometric properties of the Romanian adaptation of the DS-R, one of the preferred instruments for measuring disgust. More specifically, the research investigated different forms of reliability and validity of the DS-R, using both Classical Test Theory (CTT) and Item Response Theory (IRT) analysis approaches. In general, the results showed good fidelity, fit of the single- factor model of the DS-R, good convergent and divergent validity with respect to the relationships of this scale with other variables. The study also highlights the important role of disgust and anxiety in predicting obsessive- compulsive symptoms. In conclusion, further refinement of the scale could be useful for a more comprehensive development of this instrument in the clinical setting.

Health behavior inventory – short form: a Chinese validation study using classical test theory and item response theory

BackgroundIt is imperative to use a validated tool to measure and understand health behavior as it greatly impacts health status. It has been demonstrated that the Health Behavior Inventory - Short Form (HBI-SF) is valid in several countries. The purpose of this study was to translate the HBI-SF into Chinese and test its psychometric properties.MethodsThis study employed a two-phase methodology. The phase one entailed the cross-cultural adaptation of the HBI-SF, while the subsequent phase evaluated the psychometric properties of the scale. This evaluation encompassed classical test theory (CTT) and item response theory (IRT) tests to assess reliability and validity. It involved 1058 participants, of whom 1036 completed the questionnaire successfully. Out of these, 518 were analyzed for CTT, along with 518 for IRT.ResultsThe S-CVI was found to be 0.935, while the I‐CVI ranged from 0.889 to 1.000. The results of the confirmatory factor analysis suggested the goodness-of-fit indices for the four-factor model was acceptable. Regarding the subscales, the average variance extracted (AVE) and Heterotrait-Monotrait Ratio of Correlations (HTMT) matrix also met the cutoff values (AVE > 0.5 and HTMI < 0.85). Furthermore, the internal consistency and composite reliability indices of all factors were greater than 0.7. Infit and/or outfit values indicated that all items fitted the Rasch model. The Wright map revealed that the average person measures for the participants (mean = − 0.994, SD = 0.430) were comparatively lower than the average item measures (mean = 0.000, SD = 0.257). The person separation reliability values for the four factors ranged from 0.600 to 0.746, indicating an acceptable level of reliability. Two items showed differential item functioning.ConclusionsThe findings derived from both CTT and IRT analyses demonstrate favorable levels of reliability and validity for the Chinese version of the HBI-SF.

The Development and Validation of a Disordered Eating Screening Tool for Current and Former Athletes: The Athletic Disordered Eating (ADE) Screening Tool.

Current and former athletes are one of the most at-risk population groups for disordered eating (DE), impacting their dietary practices, body composition, performance and health during and following their athletic careers. Few comprehensive DE screening tools exist for this group. To help address this, the current study utilised a mixed-methods approach of Classic Test Theory (CTT) and Item Response Theory (IRT) to develop and validate a DE screening tool suitable for current and former athletes. Novel scale development methodologies were used to develop and assess the validity (content, face, cross-cultural, construct), test-retest reliability, internal consistency reliability, factor analysis and Rasch analysis of a new DE scale. A new validated Athletic Disordered Eating (ADE) screening tool was created, with 17 items and four subscales (food control, bingeing, body control, body discontent), with an internal consistency reliability of 0.91, excellent content and construct validity, an Intraclass Correlation Coefficient of 0.97 and excellent Rasch model fit. The ADE screening tool has been dually developed for research purposes and as a clinically applicable screening tool to detect DE in current and former athletes and is suitable for a global use across sporting categories, diverse genders and levels of competition.

Gerascophobia or Excessive Fear of Aging Scale (GEFAS): Development, validation, and exploration of psychometric properties of a brief instrument using classical testing theory and item response theory

BackgroundGerascophobia, or excessive fear of aging, is thought to be caused by a mixture of cognitive, experiential, and physiological factors acting on a person at particular time points. Measurement tools for evaluating geraschophobia remain insufficiently developed, despite this commonplace fear's distress. ObjectiveThe objective of the current study was to develop and validate the Gerascophobia or Excessive Fear of Aging Scale (GEFAS) and analyze its psychometric properties. MethodsThree successive investigations were carried out with a total of 1594 participants. Exploratory and confirmatory factor analyses were conducted to evaluate the construct validity of the GEFAS. Convergent and discriminant validity was assessed by examining relationships with measures of depression, anxiety, stress, death anxiety, psychosocial illness, and life satisfaction. Multiple linear regression was used to investigate factors that predict fear of aging. ResultsThe GEFAS demonstrated high reliability (Cronbach alpha >0.8). Factor analysis supported a single-factor solution for the scale (fitness indices CFI, TLI, NNFI, NFI, RFI, and MFI all > 0.95; RMSEA=0.06. Significant positive correlations were found between fear of aging and depression (r = 0.270; p < 0.01), anxiety (r = 0.311; p < 0.01), stress (r = 0.285; p < 0.01), death anxiety (r = 0.600; p < 0.01), and psychosocial illness (r = 0.243; p < 0.01). A significant inverse correlation was observed with life satisfaction. Gender differences were also noted, with women exhibiting greater fear of aging than men (p < 0.01; d = 0.488). ConclusionThe GEFAS fills a significant gap in the psychological/psychiatric literature as a useful tool for evaluating the fear of aging. The study concludes that the excessive fear of aging contributes to poor mental health.

The Mayo Leadership Impact Index Adapted for Matrix Leadership Structures: Initial Validity Evidence.

Physician burnout has reached crisis levels. Supportive leadership is one of the strongest drivers of physician well-being, and monitoring supervisor support is key to developing well-being focused leadership skills. Existing measures of leader support were designed within "direct report" supervision structures limiting their applicability to matrixed leadership reporting structures where direct reports are not the predominant norm. Antecedently, no measure of leadership support is validated specifically for implementation in matrixed leadership structures. Adapt and validate the Mayo Leadership Impact Index (MLII) for settings with matrixed leadership structures. A psychometric validation study utilizing classical test theory and item response theory. A tripartite hospital system in the southwestern US. Physician-respondents to a 2023 cross-sectional survey. After pilot testing, the adapted MLII was examined using a unidimensional graded response model and confirmatory factor analyses. Convergent validity was investigated via correlations with professional fulfillment, perceived autonomy support, self-valuation, and peer connectedness/respect. Divergent validity was tested via correlations with burnout. Of the three candidate revisions of the MLII, the 9-item adaptation was selected for its superior validity/reliability indices. Standardized Cronbach's and Ordinal alpha coefficients were 0.958 and 0.973, respectively. CFA loadings exceeded 0.70 (p < 0.001), and coefficients of variation (R2) exceeded 0.60 for all items. GRM slope parameters indicated "high" to "very high" item discrimination. Items 2, 5, and 8 were the most informative. Positive correlations of the adapted MLII with professional fulfillment, perceived autonomy support, and peer connectedness/respect were observed, supporting convergent validity. Negative correlation with overall burnout supports divergent validity. The findings provide evidence of the adapted MLII's validity, reliability, and appropriateness for implementation within matrixed leadership settings. Prior to this study, no leadership support measure had been validated for use among the growing number of healthcare systems with matrixed leadership reporting structures.

Cross-cultural adaptation and validation of the caregiver self-efficacy in contributing to patient self-care scale in China

BackgroundCaregiver self-efficacy is crucial in improving patient outcomes and caregiver well-being, but there is a lack of suitable scales to assess this concept within the context of Chinese culture. This study aimed to cross-culturally translate the Caregiver Self-Efficacy in Contributing to Patient Self-Care (CSE-CSC) Scale and evaluate its psychometric properties using classical test theory and item response theory.MethodsThe CSE-CSC scale was adapted using Brislin’s translation model after obtaining authorization from the original author. A multicenter, cross-sectional study was conducted to assess the psychometric properties of this scale. Classical test theory was used to evaluate reliability (internal consistency, test-retest reliability), validity (content validity, structural validity, convergent validity), and floor and ceiling effects. Item response theory was employed to assess the fit of the rating scale model, reliability, item difficulties, and measurement invariance.ResultsThe translation and cultural adaptation process was completed. Classical test theory demonstrated good internal consistency (Cronbach’s α = 0.935) and test-retest reliability (ICC from 0.784 to 0.829, p<0.001). The I-CVI and K* of each item ranged from 0.875 to 1.00 and 0.871 to 1.00. The first-order 2-factor model fit well (χ2/df = 3.71, RMSEA = 0.082, SRMR = 0.032, CFI = 0.973, TLI = 0.60). Convergent validity showed that the CSE-CSC scores had a strong positive correlation with three separate scales of the CC-SC-CII. There was no floor and ceiling effect in this scale. Rasch analysis showed that the CSE-CSC scale demonstrated a good fit to the rating scale model and exhibited excellent reliability (person/item separation index>2, person/item reliability coefficients>0.8). The Wright map showed that item difficulty matched the respondents’ measured abilities. The analysis of differential item functioning (DIF) showed that all items were comparable in gender.ConclusionsThis study indicated that the CSE-CSC scale had good reliability, validity, difficulty degree, and measurement invariance. The CSE-CSC scale can be used to measure caregiver self-efficacy of Chinese patients with multiple chronic conditions.

Validation of the Maslach Burnout Inventory-General Survey 9-item short version: psychometric properties and measurement invariance across age, gender, and continent.

The Maslach Burnout Inventory-General Survey (MBI-GS) stands as the preeminent tool for assessing burnout across various professions. Although the MBI-GS9 emerged as a derivative of the MBI-GS and has seen extensive use over several years, a comprehensive examination of its psychometric properties has yet to be undertaken. This study followed the Standards for Educational and Psychological Testing guidelines to validate the MBI-GS9. Employing a combined approach of classical test theory and item response theory, particularly Rasch analysis, within an integrated framework, the study analyzed data from 16,132 participants gathered between 2005 and 2015 by the Centre for Organizational Research at Acadia University. The findings revealed that the MBI-GS9 exhibited satisfactory reliability and validity akin to its predecessor, the MBI-GS. Across its three dimensions, Cronbach's α and omega coefficients ranged from 0.84 to 0.91. Notably, the MBI-GS9 displayed no floor/ceiling effects and demonstrated good item fit, ordered threshold, acceptable person and item separation and reliability, clear item difficulty hierarchy, and a well-distributed item threshold. However, the results suggested a recommended minimum sample size of 350 to mitigate potential information loss when employing the MBI-GS9. Beyond this threshold, the observed mean difference between the MBI-GS and MBI-GS9 held minimal practical significance. Furthermore, measurement equivalence tests indicated that the MBI-GS9 maintained an equivalent three-factor structure and factor loadings across various gender, age, and continent groups, albeit with inequivalent latent values across continents. In sum, the MBI-GS9 emerges as a reliable and valid alternative to the MBI-GS, particularly when utilized within large, diverse samples across different age and gender demographics. However, to address potential information loss, a substantial sample size is recommended when employing the MBI-GS9. In addition, for cross-cultural comparisons, it is imperative to initially assess equivalence across different language versions at both the item and scale levels.

Psychometric Properties of the Bangla Version of the Big Five Personality Inventory-10

Shorter assessing instrument for measuring psychological construct is on the rise in recent years. Personality measuring instruments are not an exception to this. The present study aimed to assess the psychometric properties of the Bangla version of the Big Five Personality Inventory–10 (BFI-10). This instrument was translated into Bangla and back-translated into English by following the International Test Commission's guidelines. After the pretest, the translated version of this scale was administered on a sample of 372 students. Psychometric properties were estimated through both classical test theory and item response theory. Findings revealed that the Bangla version of this scale had sufficient inter-item correlations, inter-factor correlations, test-retest reliability, non-DIF contrast, and Rasch model fit. This translated scale would be applicable to assess the personality of the Bangladeshi people and fulfill the demand fora short version of the personality assessment scale in the Bangladesh context. The Chittagong Univ. J. B. Sci.,Vol. 10(1&amp;2):71-80, 2020

WeChat assisted electronic symptom measurement for patients with adenomyosis

PurposeSymptom assessment is central to appropriate adenomyosis management. Using a WeChat mini-program-based portal, we aimed to establish a valid symptom assessment scale of adenomyosis (AM-SAS) to precisely and timely identify needs of symptom management and ultimately, to alert disease recurrence.MethodsA combination of intensive interviews of patients with adenomyosis and natural language processing on WeChat clinician-patient group communication was used to generate a pool of symptom items-related to adenomyosis. An expert panel shortened the list to form the provisional AM-SAS. The AM-SAS was built in a Wechat mini-programmer and sent to patients to exam the psychotically validity and clinical applicability through classic test theory and item response theory.ResultsTotal 338 patients with adenomyosis (29 for interview, 179 for development, and 130 for external validation) and 86 gynecologists were included. The over 90% compliance to the WeChat-based symptom evaluate. The AM-SAS demonstrated the uni-dimensionality through Rasch analysis, good internal consistency (all Cronbach’s alphas above 0.8), and test-retest reliability (intraclass correlation coefficients ranging from 0.65 to 0.84). Differences symptom severity score between patients in the anemic and normal hemoglobin groups (3.04 ± 3.17 vs. 5.68 ± 3.41, P < 0.001). In external validation, AM-SAS successfully detected differences in symptom burden and physical status between those with or without relapse.ConclusionElectronic PRO-based AM-SAS is a valuable instrument for monitoring AM-related symptoms. As an outcome measure of multiple symptoms in clinical trials, the AM-SAS may identify patients who need extensive care after discharge and capture significant beneficial changes of patients may have been overlooked.Trial registrationThis trial was approved by the institutional review board of the Chongqing Medical University and three participating hospitals (Medical Ethics Committee of Nanchong Central Hospital, Medical Ethics Committee of Affiliated Hospital of Southwest Medical University, and Medical Ethics Committee of Haifu Hospital) and registered in the Chinese Clinical Trial Registry (registration number ChiCTR2000038590), date of registration was 26/10/2020.

The relationship between ambulance team’s professional commitment, occupational anxiety, and resilience levels

BackgroundIndividuals who have the ability to bounce back from stressful events, to recover from their troubles and adverse environmental conditions by getting stronger each time are known as resilient people. Some professions may cause more occupational anxiety than others due to their characteristics and working conditions. In this research, we aimed to develop a professional commitment scale for the ambulance team. Another aim was to analyze the relationships between professional commitment, occupational anxiety, resilience, gender, job, seniority and working unit variables.MethodsIn the study, data were collected from a total of 1142 emergency ambulance workers working in Emergency Ambulance and Emergency Call Centers in 34 different cities in Turkey. Data were collected using the “Professional Commitment of Ambulance Team Scale (PCATS), Occupational Anxiety Scale for Emergency Medical Service Professionals (OASEMSP), and Resilience Scale for Adults (RSA). Scale development analyses were carried out using Classical Test Theory (CTT) and Item Response Theory (IRT). Regression analysis were used to examine the relationships between professional commitment, occupational anxiety, resilience, gender, job, seniority and working unit.ResultsAs a result of the exploratory factor analysis (EFA), it was determined that 8 items remaining in the professional commitment scale formed a single-factor structure, explaining 46% of the variance of professional commitment of the team. The Cronbach’s Alpha reliability value was 0.867. Confirmatory factor analysis (CFA) confirmed the results of exploratory factor analysis. The Cronbach’s Alpha reliability coefficient obtained through CTT was 0.868, and the marginal reliability coefficient within the scope of IRT was 0.877. The test-retest reliability coefficient was calculated as 0.832, which indicates that the scale is valid and reliable.ConclusionsThe study revealed that resilience has a positive effect for professional commitment while occupational anxiety has a negative effect for professional commitment. In addition, having a moderate seniority has a negative (reducing) effect for professional commitment. Other variables (gender, job, and working unit) was found to have no significant impact on professional commitment.

Unveiling Inequality: Mapping Asset Disparities in Azad Jammu and Kashmir (Pakistan)

The main objectives of this study are to construct a valid and reliable asset index at the household level for 10 districts of Azad Jammu and Kashmir (AJK) by using Multiple Indicators Cluster Survey micro-data and to estimate economic disparities by calculating Gini-coefficient and Palma Ratio. The asset index is considered a better estimate than expenditures or current household income to gauge a household’s living standard and its potential resilience to deal with economic shocks. The dimensional structure of assets is assessed by applying Exploratory Factor Analysis (EFA) and Tetrachoric Principal Component Analysis (PCA). Further, this paper has applied Classical Test Theory (CTT) and Item Response Theory (IRT) to ensure the reliability of the household-based asset index. Furthermore, the Gini-coefficient and Palma ratios are estimated by using the composite household-based asset index to estimate economic disparities in all 10 districts of AJK. The dimensional structure of assets, reliability, and validity analysis suggest to use 21 assets (out of 30 items) to construct the household-based asset index. The nine items (assets) are excluded from the analysis to avoid systematic errors and random errors. The results show that districts Bhimber and Mirpur have achieved the highest average asset scores, which are 0.62 and 0.64 respectively. The score of the Gini-coefficient index and the Palma ratio analyses shows that the asset distribution in the districts Neelum and Haveli are highly unequal. The Gini-coefficient is highly responsive to midpoint distribution while the Palma ratio concentrates more on top and bottom distribution, and it ignores the middle 50 percent from the analysis. Interestingly, both approaches have produced similar district rank ordering because we have adopted a systematic process for construct validity and reliability to minimize measurement errors.

Validation of the Chinese version of the Oslo-3 Social Support Scale among nursing students: a study based on Classical Test Theory and Item Response Theory models

BackgroundNursing students are encountering a range of health issues. Assessing social support is a key component in most questionnaire surveys related to health status, aiming to investigate the relationships and mechanisms between health status and social support to enhance overall health. Therefore, it is essential to seek out appropriate instruments to evaluate social support for nursing students. The Oslo-3 Social Support Scale (OSSS-3) is a reliable and concise instrument for evaluating social support. To date, there have been no studies validating the OSSS-3 based on Item Response Theory (IRT) models. Also, an officially validated Chinese version has not been found. The current research intended to verify the Chinese version of the OSSS-3.MethodsThe OSSS-3 was translated into Chinese and culturally adapted. Subsequently, the OSSS-3 was validated by employing the Classical Test Theory (CTT) and IRT models.ResultsThe split-half reliability was 0.622. The Cronbach’s α coefficient was 0.687. The correlations between each item and total scores varied from 0.723 to 0.835. The retest coefficient was 0.907. The content validity index was 0.933. A single common factor was extracted and accounted for 61.559% of the variance. The item loading values on the single factor were between 0.743 and 0.814. The communalities were between 0.552 and 0.663. There was no variance between males and females (P = 0.055). The difference in scores between the top (30%) and bottom (30%) groups attained significance. IRT models results revealed that the discrimination parameters ranged from 1.39 to 2.33 and difficulty parameters increased monotonically.ConclusionThe OSSS-3 demonstrates satisfying psychometric properties and is a proper instrument for measuring social support in Chinese nursing students.

Study on the applicability of the Brief Job Stress Questionnaire based on classical test theory and item response theory

Objective: To evaluate the quality and item characteristics of the Brief Job Stress Questionnaire (BJSQ) among employees in manufacturing and service industries. Methods: From December 2021 to December 2022, a total of 2077 employees from 4 manufacturing and service enterprises in Beijing were selected by the method of combining purpose sampling and convenience sampling. The Chinese version of BJSQ was used to carry out a survey on occupational stress from 57 items in 4 dimensions including job stress factors, stress response, social support factors and satisfaction. Classical test theory (CTT) was used to analyze the validity and reliability of the questionnaire. The Semejima hierarchical response model in item response theory (IRT) was used to analyze the differentiation a, difficulty coefficient b and information content of each item. Results: Among the 2077 subjects, the age M (Q(1), Q(3)) was 33 (28, 37) years old, and the working age M (Q(1), Q(3)) was 4 (2, 8) years. There were 723 (34.8%) people in manufacturing industry and 1354 (65.2%) people in service industry. Eleven common factors were extracted by exploratory factor analysis, with a cumulative variance contribution rate of 62.823%, the variance of the common factors of each entry ranging from 0.451 to 0.865, and the range of factor loading values from 0.413 to 0.825, with 5 items having cross-loadings. The results of the validation factor analysis showed that the model fit indexes of root means square error of approximation was 0.055, comparative fit index was 0.950, Tucker Lewis index was 0.948, and standardized root mean square was 0.066. Content validity results showed that the total scores of the Chinese version of the BJSQ were positively correlated with the scores of the 4 dimensions (r(s)=0.487-0.936, P<0.05) . The results of the reliability analysis showed that the Cronbach's alpha coefficient for the total questionnaire was 0.945, and the Cronbach's alpha coefficients of job stress factors, stress response and social support factors were 0.775, 0.957, and 0.830, respectively. The Spearman-Brown coefficient for the total questionnaire was 0.866, and for the 3 dimensions, it was 0.572, 0.882 and 0.772. The results of IRT analysis showed that only 1 of the 57 items had a differentiation a-value<0.30, the difficulty coefficient b-value of each item ranged from -12.02 to 11.09, of which 8 items had a difficulty coefficient that was too high, 3 items had a difficulty coefficient that was too low, and 3 items did not meet the requirements, and the average amount of information in each item ranged from 0.022 to 2.566, and there were 47 items with average amount of information>0.088 (5/57) . Conclusion: The Chinese version of BJSQ has good reliability and validity in the typical occupational groups of manufacturing and service industries in China, and most of the items have good performance, but some items still need to be further improved and optimized or deleted.

Digital literacy scale: Validity and reliability study with the rasch model

AbstractThe study aimed to develop a Likert-type measurement tool (Digital Literacy Scale, DLS) to determine the digital literacy levels of secondary school students. The validity and reliability of the developed measurement tool were verified using the Rasch model. The Rasch Model can estimate missing data and allow for small study groups (Rasch, Rasch, Probabilistic models for some intelligence and attainment tests, Danish Institute for Educational Research, 1960). Additionally, this model can verify the expected pattern of the measurement tool by calibrating it across participants and items. The content validity of DLS was ensured by expert opinion, and the construct validity was ensured by using the Rach model. In the content validity study, a 25-item pool was created for the draft DLS, and 5 items were removed from the draft DLS at this stage. Construct validity studies were carried out with the remaining 20 items using the classical test theory and item response theory (Rasch model). Exploratory Factor Analysis (EFA) and first-level Confirmatory Factor Analysis (CFA) were used within the scope of classical test theory. Then some Rasch assumptions such as dimensionlessness, local independence, monotonicity, and bias were tested for DLS. In the validity and reliability analysis of DLS, no items were eliminated, and the quantitative theoretical results were statistically confirmed. The analysis results showed that the minimum statistical values required for a good measurement tool were met. Accordingly, 20 valid and reliable compatible items that can be used to determine the digital literacy status of secondary school students were produced.