Internal Consistency Reliability Research Articles

Psychometric evaluation of Suicide Management Competency Scale for nursing students: A cross-sectional study.

Suicide management skills are essential for nursing students, as they are often the initial healthcare contact for individuals at risk of suicide. Recognising signs of suicidal ideation and behaviour is critical for initiating timely interventions. This study aimed to develop and access the psychometric evaluation of the Suicide Management Competency Scale (SMCS) for nursing students. A first draft of the SMCS was initially developed following literature and focus group, and a scale containing 28 items was constructed. We recruited 216 participants from two nursing schools. Construct validity was evaluated with exploratory factor analysis (EFA). Internal consistency reliability was determined with Cronbach's alpha, and test-retest reliability was examined with intra-class correlation. After four rounds of EFA and item analysis, we reduced the number of items to 16. We deleted 12 items, including 4 items for communalities less than 0.40, 3 items for cross-loading, 3 items for factor loading less than 0.40, and 2 items for low corrected item-total correlation. The final 16-item SMCS resulted in three subscales, which explained 55.813% of the total variance: emotional challenges in suicide risk assessment, delivering suicide interventions, and suicide risk nursing competence and confidence. Cronbach's alpha was 0.854 for the total score and 0.748 to 0.847 for the subscales. The newly developed SMCS was found to have good reliability and validity, suggesting that this scale could be used to evaluate nursing students' perceived competency in managing suicide, which might help cultivate competence in nurses' ability to effectively manage and prevent suicide, thus contributing to saving lives.

Validity and Reliability of the Empowered Veteran Index-Short Form (EVI-SF)

ABSTRACT Purpose Veteran empowerment may include connection, community impact, and personal growth. At least one valid and reliable tool has been developed to measure the aforementioned framework: the empowered veteran index (EVI). However, there is a need for a shorter measure to prevent survey fatigue. Materials and methods We recruited military veteran members of a nonprofit (n = 316), The Mission Continues, for participation in this cross-sectional online survey study. Participants completed the 35-item EVI. A short form of the EVI (EVI-SF) was developed through bifactor confirmatory factor analysis (CFA). Results The 10-item EVI-SF model demonstrated satisfactory performance (χ2 p = 0.68, SRMR = 0.02, RMSEA = 0.01, CFI = 0.99, TLI = 0.99). All factor loadings in this model were ≥ 0.30, providing evidence for the validity of the interval structure. Internal consistency reliability was good for all three subscales (omegas >0.7). Discussion Analysis of the EVI-SF showed that the instrument was valid and reliable. The EVI-SF contains 10 items with seven-point Likert scale response options. Use of the instrument may provide for the opportunity to measure empowerment of military veterans. Conclusion This study provides preliminary psychometric validation of the EVI-SF.

Psychometric properties of the experiences of maternity care scale among Iranian women

BackgroundAssessing women’s perceptions of the care they receive is crucial for evaluating the quality of maternity care. Women’s perceptions are influenced by the care received during pregnancy, labour and birth, and the postpartum period, each of which with unique conditions, expectations, and requirements. In England, three Experience of Maternity Care (EMC) scales – Pregnancy, Labour and Birth, and Postnatal – have been developed to assess women’s experiences from pregnancy through the postpartum period. This study aimed to validate these scales within the Iranian context.MethodsA methodological cross-sectional study was conducted from December 2022 to August 2023 at selected health centers in Tabriz, Iran. A panel of 16 experts assessed the qualitative and quantitative content validity of the scales and 10 women assessed the face validity. A total of 540 eligible women, 1–6 months postpartum, participated in the study, with data from 216 women being used for exploratory factor analysis (EFA) and 324 women for confirmatory factor analysis (CFA) and other analyses. The Childbirth Experience Questionnaire-2 was employed to assess the convergent validity of the Labour and Birth Scale, whereas women’s age was used to assess the divergent validity of the scales. Test-retest reliability and internal consistency were also examined.ResultsAll items obtained an impact score above 1.5, with Content Validity Ratio and Content Validity Index exceeding 0.8. EFA demonstrated an excellent fit with the data (all Kaiser-Meyer-Olkin measures > 0.80, and all Bartlett’s p < 0.001). The Pregnancy Scale exhibited a five-factor structure, the Labour and Birth Scale a two-factor structure, and the Postnatal Scale a three-factor structure, explaining 66%, 57%, and 62% of the cumulative variance, respectively, for each scale. CFA indicated an acceptable fit with RMSEA ≤ 0.08, CFI ≥ 0.92, and NNFI ≥ 0.90. A significant correlation was observed between the Labour and Birth scale and the Childbirth Experience Questionnaire-2 (r = 0.82, P < 0.001). No significant correlation was found between the scales and women’s age. All three scales demonstrated good internal consistency (all Cronbach’s alpha values > 0.9) and test-retest reliability (all interclass correlation coefficient values > 0.8).ConclusionsThe Persian versions of all three EMC scales exhibit robust psychometric properties for evaluating maternity care experiences among urban Iranian women. These scales can be utilized to assess the quality of current care, investigate the impact of different care models in various studies, and contribute to maternal health promotion programs and policies.

Turkish adaptation of a brief self-report measure of fantasy proneness: The Creative Experiences Questionnaire (CEQ)

AbstractThis research addresses the construct of fantasy proneness that is unexplored in the context of Turkey by adapting and assessing the psychometric properties of the widely accepted Creative Experiences Questionnaire (CEQ), aiming to fill a significant gap in existing literature and contribute to the understanding of this construct and its correlates in a population aged between 18 and 60 years. The Turkish version of the CEQ demonstrated face validity, aligning participant responses with fantasy, imagination, and dissociation (n = 15). Exploratory Factor Analysis confirmed a single-factor solution based on the scree plot graphic, without item removal (n = 310). Reliability and validity analyses (N = 464) affirmed robustness with adequate internal consistency (Cronbach’s Alpha = 0.78, McDonald’s Omega = 0.77) and test-retest reliability (n = 110, r = .72). Convergent validity was supported by correlations with dissociative experiences (r = .51) and magical ideation (r = .51). Discriminant validity was evident in negative correlations with social desirability (r = -.10, p &lt; .05), notably, impression management (r = -.12, p &lt; .05), indicating unbiased capture of fantasy experiences. Predictive validity was supported by a positive correlation observed between fantasy proneness and interest in creative activities (r = .21). Participants engaged in or aspiring to engage in creative activities professionally scored notably higher, broadening implications for creativity research. Similarities between the original and Turkish versions suggested cultural variations do not significantly affect fantasy proneness in adults. Considering limitations, future research should explore age-related variations of fantasy proneness as well as its association with social desirability. Implications extend to clinical research, emphasizing consideration of fantasy proneness and its correlates in psychopathological and broader psychological health studies in Turkey and globally.

Psychometric testing of the caregiver contribution to self-care of coronary heart disease inventory.

Caregivers are important contributors to the self-care of patients with coronary heart disease (CHD). The aims of this study are to describe the development and psychometric properties of the caregiver contribution to self-care of coronary heart disease inventory (CC-SC-CHDI). The CC-SC-CHDI was developed from the patient version of the scale, the Self-care of Coronary Heart Disease Inventory (SC-CHDI) and translated into Italian using forward and backward translation. Baseline data from the HEARTS-IN-DYADS study were used. Confirmatory factor analysis (CFA) was conducted to assess factorial validity; Cronbach's alpha and the model-based internal consistency index were used to test internal consistency reliability, and Pearson's correlation coefficient was used to test convergent validity, by investigating the association between the CC-SC-CHDI and the SC-CHDI scores. We included 131 caregivers (mean age 55 years, 81.2% females, 74% married) of patients affected by CHD (mean age 66 years, 80.2% males, 74% married). The CFA confirmed two factors in the caregiver contribution to self-care maintenance scale ("consulting behaviors" and "autonomous behaviors"), one factor for the CC to self-care monitoring scale, and two factors in the CC to self-care management scale ("consulting behaviors and problem-solving behaviors"). Reliability estimates were adequate for each scale (Cronbach's alpha and model-based internal consistency indexes ranging from 0.73 to 0.90). Significant and positive correlations were observed between CC-SC-CHDI and SC-CHDI scales. The CC-SC-CHDI has satisfactory validity and reliability and can be used confidently in clinical settings and research to assess caregiver contributions to CHD self-care.

An evaluation of the psychometric properties of the Australian Collaborative Practice Assessment Tool

Objectives This study aimed to validate the Collaborative Practice Assessment Tool (CPAT) in the Australian setting and provide a quality instrument in terms of psychometric properties that can be used to measure interprofessional outcomes for both healthcare practitioners and students. The outcomes evaluated include the capacity to work in an interprofessional team, good interprofessional communication skills, leadership skills, ensuring clear division of tasks and roles in a team, effective conflict management, and being actively involved with patients and their families/communities in care. Methods The COSMIN (COnsensus-based Standards for the selection of health Measurement INstruments) taxonomy and standards were used as guides for evaluating the psychometric properties of the Australian CPAT, which include evaluations regarding instrument development requirements of sample target and size, content validity, internal structure (structural validity, internal consistency reliability and measurement invariance), and hypotheses testing. CPAT Australia was developed through two stages involving pilot studies and a validation study, both of which included healthcare practitioners and students as participants. A pilot study examined content validity regarding item relevance, item comprehensibility, and instrument comprehensiveness. The validation study was carried out to assess the internal structure of CPAT Australia for aspects of structural validity, internal consistency reliabilities, and configural, metric and scalar measurement invariance. The structural validity was explored using the following three steps: exploratory, confirmatory, and multi-group factor analysis. Construct validity was evaluated to confirm direct and indirect paths of assumptions based on a previously validated model. Data collected between August 2021 and May 2022. Results The content validity evaluation confirmed that all items were relevant, understandable and comprehensive for measuring interprofessional collaborative care in Australia. Three hundred ninety-nine participants contributed to the validation study (n=152 practitioners; n=247 students). The original instrument model of 8-Factor 56-Item was improved in the Australian CPAT. Two items, Item 27 (Physicians assume the ultimate responsibility) and Item 49 (Final decision rest with the physician), were consistently rejected and therefore discarded. The internal structure of the 7-Factor 54-Item solution was confirmed as a suitable model with fit indices meeting COSMIN standards for a good model in practitioner and student cohorts. Configural, metric and scalar invariances were confirmed, indicating the invariance of the instruments when used for the practitioner and student cohorts. The construct validity evaluation indicated that 81.3% of direct and indirect assumptions were accepted, fulfilling the COSMIN requirement of &gt;75% of proposed assumptions being accepted. Conclusion The Australian CPAT with a 7-factor 54-item solution was confirmed as a quality measure for assessing interprofessional education and collaborative practice for both healthcare practitioners and students in Australia with robust psychometric properties.

Influence of Principals’ Promotion of Professional Development of Teachers on Learners’ Academic Performance in Kenya Certificate of Secondary Education in Kisii County, Kenya

Effective professional development should take cognisance of the needs of teachers, learners and school context. It has been established by research studies that divergent and overlapping policies as well as dysfunctional schooling cultures have frustrated impact of professional development of teachers on good quality learning outcomes. The purpose of this study was to investigate the Influence of Principals’ promotion of teachers’ professional development on learners’ academic performance in Kenya Certificate of Secondary Education (K.C.S.E.) in Public Schools in Kisii County, Kenya The objective of this study was to: explore the influence of Principals’ promotion of professional development of teachers on learners’ academic performance in K.C.S.E.in Kisii County. This study was anchored on Karl Ludwig von Bertalanffy General Systems Theory. Mixed method research design of explanatory sequential type with a prioritized quantitative approach in phase one followed by qualitative approach in phase two was applied in the study. The target population was 4,691 participants which included: 340 Principals, 1360 Heads of Departments (H.O.Ds) and 2,991 teachers. A sample of 451 respondents participated in the study. The researcher used proportionate stratified random sampling technique to select 85 schools, 114 H.O.Ds and 252 teachers. Census sampling to select national and special schools while 85 Principals of the selected schools were purposefully sampled. Questionnaires and interview guides were used to collect quantitative and qualitative data respectively. Content validity, Criterion validity, Construct validity and Face validity, of the research instruments were ensured through evaluation by the University supervisors and other experts while internal consistency reliability was estimated by using Cronbach’s alpha coefficient formula which yielded alpha coefficient of over 0.7 which was considered adequate. Quantitative data were analysed using Statistical Package of Social Sciences (SPSS) Version 29 while qualitative data were analysed thematically and presented using word verbatim from the respondents and integrated with the findings of phase one. Descriptive statistics were presented in tables and graphs while inferential statistics were presented in terms of Pearson’s correlation coefficients, Anova and Regression coefficients. The study found out a weak positive insignificant influence between promotion of professional development of teachers (r=.011, p≤.05; 2 tailed) and learners’ academic performance in K.C.S.E. Therefore, the null hypothesis were upheld. These results were supported by Principals’ interviews which indicated that professional development programmes are not context specific. It is hoped that the findings of this study would provide information that would form a base for corrective measures towards the unexpected low academic performance in the study locale. The study recommended that further research should be done on influence of principals’ leadership skills development on academic performance in K.C.S.E.

Serbian Version of the eHealth Literacy Questionnaire (eHLQ): Translation, Cultural Adaptation, and Validation Study Among Primary Health Care Users.

As digital health services are increasingly developing and becoming more interactive in Serbia, a comprehensive instrument for measuring eHealth literacy (EHL) is needed. This study aimed to translate, culturally adapt, and investigate the psychometric properties of the Serbian version of the eHealth Literacy Questionnaire (eHLQ); to evaluate EHL in the population of primary health care (PHC) users in Serbia; and to explore factors associated with their EHL. The validation study was conducted in 8 PHC centers in the territory of the Mačva district in Western Serbia. A stratified sampling method was used to obtain a representative sample. The Translation Integrity Procedure was followed to adapt the questionnaire to the Serbian language. The psychometric properties of the Serbian version of the eHLQ were analyzed through the examination of factorial structure, internal consistency, and test-retest reliability. Descriptive statistics were calculated to determine participant characteristics. Differences between groups were tested by the 2-tailed Students t test and ANOVA. Univariable and multivariable linear regression analyses were used to determine factors related to EHL. A total of 475 PHC users were enrolled. The mean age was 51.0 (SD 17.3; range 19-94) years, and most participants were female (328/475, 69.1%). Confirmatory factor analysis validated the 7-factor structure of the questionnaire. Values for incremental fit index (0.96) and comparative fit index (0.95) were above the cutoff of ≥0.95. The root mean square error of approximation value of 0.05 was below the suggested value of ≤0.06. Cronbach α of the entire scale was 0.95, indicating excellent scale reliability, with Cronbach α ranging from 0.81 to 0.90 for domains. The intraclass correlation coefficient ranged from 0.63 to 0.82, indicating moderate to good test-retest reliability. The highest EHL mean scores were obtained for the understanding of health concepts and language (mean 2.86, SD 0.32) and feel safe and in control (mean 2.89, SD 0.33) domains. Statistically significant differences (all P<.05) for all 7 eHLQ scores were observed for age, education, perceived material status, perceived health status, searching for health information on the internet, and occupation (except domain 4). In multivariable regression models, searching for health information on the internet and being aged younger than 65 years were associated with higher values of all domain scores except the domain feel safe and in control for variable age. This study demonstrates that the Serbian version of the eHLQ can be a useful tool in the measurement of EHL and in the planning of digital health interventions at the population and individual level due to its strong psychometric properties in the Serbian context.

Reliability and validity of a novel attention assessment scale (broken ring enVision search test) in the Chinese population

BackgroundThe correct assessment of attentional function is the key to cognitive research. A new attention assessment scale, the Broken Ring enVision Search Test (BReViS), has not been validated in China. The purpose of this study was to assess the reliability and validity of the BReViS in the Chinese population.MethodsFrom July to October 2023, 100 healthy residents of Changzhou were selected and subjected to the BReViS, Digital Cancelation Test (D-CAT), Symbol Digit Modalities Test (SDMT), and Digit Span Test (DST). Thirty individuals were randomly chosen to undergo the BReViS twice for test–retest reliability assessment. Correlation analysis was conducted between age, education level, gender, and various BReViS sub-tests including Selective Attention (SA), Orientation of Attention (OA), Focal Attention (FA), and Total Errors (Err). Intergroup comparisons and multiple linear regression analyses were performed. Additionally, correlation analyses between the BReViS sub-tests and with other attention tests were also analyzed.ResultsThe correlation coefficients of the BReViS sub-tests (except for FA) between the two tests were greater than 0.600 (p &amp;lt; 0.001), indicating good test–retest reliability. The Cronbach’s alpha coefficient was 0.874, suggesting high internal consistency reliability. SA showed a significant negative correlation with the net score of D-CAT (r = −0.405, p &amp;lt; 0.001), and a significant positive correlation with the error rate of D-CAT (r = 0.401, p &amp;lt; 0.001), demonstrating good criterion-related validity. The correlation analysis among the results of each sub-test showed that the correlation coefficient between SA and Err was 0.532 (p &amp;lt; 0.001), and between OA and Err was-0.229 (p &amp;lt; 0.05), whereas there was no significant correlation between SA, OA, and FA, which indicated that the scale had good informational content validity and structural validity. Both SA and Err were significantly correlated with age and years of education, while gender was significantly correlated with OA and Err. Multiple linear regression suggested that Err was mainly affected by age and gender. There were significant differences in the above indexes among different age, education level and gender groups. Correlation analysis with other attention tests revealed that SA negatively correlated with DST forward and backward scores and SDMT scores. Err positively correlated with D-CAT net scores and negatively with D-CAT error rate, DST forward and backward scores, and SDMT scores. OA and FA showed no significant correlation with other attention tests.ConclusionThe BReViS test, demonstrating good reliability and validity, assessing not only selective attention but also gauging capacities in immediate memory, information processing speed, visual scanning, and hand-eye coordination. The results are susceptible to demographic variables such as age, gender, and education level.

Neuropsychiatric symptoms and metamemory across the life span: psychometric properties of the German Multifactorial Memory Questionnaire (MMQ).

We assessed the psychometric properties, established normative data for the German Multifactorial Memory Questionnaire (MMQ), and analyzed its association with neuropsychiatric factors across the life span to provide a validated metamemory assessment for a German-speaking population. The three MMQ scales (memory satisfaction, self-rated ability, and strategy application) were translated into German, considering cultural, linguistic, and conceptual aspects. To validate the MMQ and assess associations with neuropsychiatric factors, the Complainer Profile Identification, Geriatric Depression Scale, Beck Anxiety Inventory, Pittsburgh Sleep Quality Index, and Short-Form-Health Survey were applied in an online study in 336 healthy participants with follow-up after 8months. Psychometric evaluation of the German MMQ showed normal distribution of all scales and good to excellent validity, internal consistency, and retest reliability. We provide percentiles and normative data for z-score conversion. Importantly, even subclinically elevated scores in depressiveness and anxiety were associated with decreased memory satisfaction and self-rated ability. Furthermore, although the influence of age on the German MMQ scales was minimal, effects of neuropsychiatric factors such as sleep quality, anxiety, and depressiveness on MMQ Satisfaction and Ability varied across the life span. Our study provides a validated German translation of the MMQ with normative data and reliability measures, including reliable change scores. We show the impact of neuropsychiatric factors on the MMQ scales across the life span and emphasize the relevance of a multifactorial approach to metamemory as a measure of individualized everyday functionality and the importance of including neuropsychiatric factors into both research and clinical assessments of metamemory.

Validating interRAI Chinese self-reported carer needs (SCaN) assessment and predicting caregiving distress among informal Chinese caregivers of older adults

BackgroundThis study aims to (1) determine the reliability and validity of the interRAI Chinese Self-reported Carer Needs (SCaN) assessment among informal Chinese caregivers of older adults, (2) identify predictors of caregiving distress in Asian regions with long-standing Confucian values of filial piety and family responsibility.MethodsThis cross-sectional study recruited 531 informal Chinese caregivers of older adults in Hong Kong, Shanghai, Taiwan, and Singapore. The scale reliability was examined using Cronbach’s alphas (α) and McDonald’s omega coefficient (ω). The concurrent validity and discriminant validity were assessed using Spearman rank correlations (rho). To examine the predictors of caregiving distress among informal caregivers of older adults, we employed hierarchical linear regression analyses informed by the Model of Carer Stress and Burden and categorized the predictors into six domains.ResultsResults revealed good internal consistency reliability (α = 0.83–0.96) and concurrent validity (rho = 0.45–0.74) of the interRAI Chinese SCaN assessment. Hierarchical linear regression analysis revealed that entering the background factors, primary stressors, secondary stressors, appraisal, and exacerbating factors all significantly enhanced the model’s predictability, indicating that the source of caregiving distress is multidimensional. In the full model, caregivers with longer informal care time, lack of support from family and friends, have unmet needs, experience role overload, have sleep problems, and low IADL functioning are at a higher risk of caregiving distress.ConclusionsThe interRAI Chinese SCaN Assessment was found to be a reliable and valid tool among the Chinese informal caregivers of older adults. It would be useful for determining family caregivers’ strengths, needs, and challenges, and tailoring interventions that address the potentially modifiable factors associated with caregiving distress and maximize support. Healthcare providers working in home and community settings should be aware of the early identification of caregiving distress and routine assessment of their needs and empower them to continue taking care of their needs and providing adequate care to the care recipient.

Validity evidence for a novel multiple-choice question bank in the field of child abuse pediatrics

BackgroundThough child abuse pediatrics has been a board-certified subspecialty for 15 years, there are few formalized board preparation resources available. ObjectiveThe purpose of this project was to establish a multiple-choice question bank with sufficient validity evidence for use in preparation for the child abuse pediatrics board examination. Participants and settingThe question bank was distributed via an electronic child abuse pediatrics mailing list. Participants completing the entire question bank included 27 board-certified child abuse pediatricians (CAPs), 19 board-eligible CAPs, and 18 CAP fellows. MethodsWe used Messick's framework to conduct the validity investigation, which includes five components: content evidence, response process, internal structure, relation to other variables, and consequences. Item analyses included difficulty index, discrimination index, and distractor analysis. We used Cronbach's alpha to estimate internal consistency reliability. We conducted linear regressions of scores on the question bank compared to in-training exam scores and career stage. ResultsEighty-four participants completed part of the question bank, and 64 completed the entire question bank. Of the original 117 questions (“items”), 94 met inclusion criteria. The mean score among board-certified CAPs was 80 %, and among participants reporting passing third-year ITE scores was 81 %. Correlation coefficient of scores on this question bank by career stage was r = 0.94, and by year of fellowship was r = 0.99. Cronbach's alpha for internal consistency reliability was 0.83. ConclusionsThis multiple-choice question bank is the first question bank with a robust validity investigation for use by child abuse pediatrics trainees.

The Chinese version of the general benefit finding scale (GBFS): Psychometric properties in a sample of college students.

Benefit finding has become a central construct in the evolution of positive psychology and attracted attention in recent literature. This study aimed to translate and validate the General Benefit Finding Scale (GBFS) in Chinese college students. Forward- and back-translation of the GBFS was followed by the assessment of semantic equivalence and content validity. A sample of 589 college students was recruited in China to conduct reliability and validity analysis. The construct validity was assessed using exploratory (EFA) and confirmatory factor analysis (CFA). Concurrent validity was assessed using Pearson's correlation coefficients of the GBFS with the Perceived Stress Scale (PSS) and World Health Organization-Five Well-Being (WHO-5). Internal consistency and two-week test-retest reliability were also evaluated. The content validity index for each item ranged from 0.83 to 1.00. EFA revealed a six-factor model, which exhibited acceptable goodness of fit in CFA (standardized root mean square residual = 0.031, root mean square error of approximation = 0.059, goodness-of-fit index = 0.860, comparative fit index = 0.904, Tucker-Lewis index = 0.890, chi-squared/degree of freedom = 2.07). The concurrent validity of the GBFS was supported by its statistically significant correlations with PSS (r = -0.271, p<0.001) and WHO-5 (r = 0.354, p<0.001). Moreover, the internal consistency for the overall scale was satisfactory, with Cronbach's α coefficient of 0.93 and McDonald's omega reliability of 0.94. The test-retest reliability was 0.82. Although the Chinese version of GBFS was examined in a homogeneous convenience sample of college students, it provides a reliable and valid instrument for assessing benefit finding in the Chinese context.

Development and validation of the osteoporosis scale among the system of quality of life instruments for chronic diseases QLICD-OS (V2.0)

BackgroundQuality of life of osteoporosis patients had caused widespread concern, due to high incidence and difficulty to cure. Scale specifics for osteoporosis and suitable for Chinese cultural background lacked. This study aimed to develop an osteoporosis scale in Quality of Life Instruments for Chronic Diseases system, namely QLICD-OS (V2.0).MethodsProcedural decision-making approach of nominal group, focus group and modular approach were adopted. Our scale was developed based on experience of establishing scales at home and abroad. In this study, Quality of life measurements were performed on 127 osteoporosis patients before and after treatment to evaluate the psychometric properties. Validity was evaluated by qualitative analysis, item-domain correlation analysis, multi-scaling analysis and factor analysis; the SF-36 scale was used as criterion to carry out correlation analysis for criterion-related validity. The reliability was evaluated by the internal consistency coefficients Cronbach’s α, test-retest reliability Pearson correlation r. Paired t-tests were performed on data of ​​the scale before and after treatment, with Standardized Response Mean (SRM) being calculated to evaluate the responsiveness.ResultsThe QLICD-OS, composed of a general module (28 items) and an osteoporosis-specific module (14 items), had good content validity. Correlation analysis and factor analysis confirmed the construct, with the item having a strong correlation (most > 0.40) with its own domains/principle components, and a weak correlation (< 0.40) with other domains/principle components. Correlation coefficient between the similar domains of QLICD-OS and SF-36 showed reasonable criterion-related validity, with all coefficients r being greater than 0.40 exception of physical function of SF-36 and physical domain of QLICD-OS (0.24). Internal consistency reliability of QLICD-OS in all domains was greater than 0.7 except the specific module. The test–retest reliability coefficients (Pearson r) in all domains and overall score are higher than 0.80. Score changes after treatment were statistically significant, with SRM ranging from 0.35 to 0.79, indicating that QLICD-OS could be rated as medium responsiveness.ConclusionAs the first osteoporosis-specific quality of life scale developed by the modular approach in China, the QLICD-OS showed good reliability, validity and medium responsiveness, and could be used to measure quality of life in osteoporosis patients.

Scale Development and Validation for Assessing University Faculty’s Knowledge, Attitudes, and Practices in Special Education

This study aims to develop and validate a scale to assess university faculty’s knowledge, attitudes, and practices in special education. A total of 210 faculty members in Taiwan participated in this study. The proposed Faculty Perspectives on Special Education Scale (FPSES), a 32-item scale, includes three subscales: Special Education Knowledge (SEK), Attitudes Towards Students (ATS), and Provision of Services (POS). Data were analyzed using descriptive statistics, item analysis, correlation analysis, t tests, exploratory factor analysis (EFA), and confirmatory factor analysis (CFA). Results showed that FPSES has satisfactory internal consistency reliability, with Cronbach’s α ranging from .93 to .96 and test-retest reliabilities, with coefficient ranging from .88 to .96. The FPSES also exhibited favorable content validity. Furthermore, the CFA confirmed a good fit between the proposed model and the sample data, thereby ensuring the construct validity. In summary, FPSES is a favorable assessment tool with good psychometric properties, which provides insights into faculty perspectives, attitudes, and practices in the provision of special education services for university students with disabilities.

Development of a Scale to Assess University Faculty’s Knowledge, Attitudes, and Practices in Special Education

With the increasing number of university students with disabilities, university professors play a significant role in teaching and assessment. The purpose of this study was to develop and validate a scale to assess university faculty’s knowledge, attitudes, and practices in relation to providing special education services. A total of 210 faculty members recruited from 15 universities in Taiwan participated in this study. The sample included lecturers (n = 51), assistant professors (n = 75), associate professors (n = 66), and professors (n = 18). The proposed Faculty Perspectives on Special Education Scale (FPSES), a 32-item scale, includes three subscales: Special Education Knowledge (SEK), Attitudes Towards Students (ATS), and Provision of Services (POS). Data collected were analyzed using descriptive statistics, item analysis, correlation analysis, t tests, exploratory factor analysis (EFA), and confirmatory factor analysis (CFA). Results showed that FPSES has satisfactory internal consistency reliability, with Cronbach’s ? ranging from .93 to .96 and test-retest reliabilities, with coefficient ranging from .88 to .96. The FPSES also exhibited favorable content validity. Furthermore, the CFA confirmed a good fit between the proposed second-order model and the sample data, thereby ensuring the construct validity. In summary, FPSES is a favorable assessment tool with good psychometric properties, which provides insights into faculty perspectives, attitudes, and practices in the provision of special education services for university students with disabilities. Recommendations are provided for future research and the Office of Disability Services at the university. Received: 29 March 2024 / Accepted: 30 April 2024 / Published: 5 May 2024

A psychometric assessment of a novel scale for evaluating vaccination attitudes amidst a major public health crisis

Despite abundant scientific evidence supporting immunization benefits, vaccine hesitancy remains a significant global health concern, particularly during public health crises. Exploring public attitudes towards vaccination is crucial. This study aimed to develop and validate a tailored Public Vaccination Attitudes Scale specifically under the unique circumstances of a public health crisis. A psychometric evaluation was conducted using a cross-sectional study during the peak of a major public health crisis. The scale was developed and its psychometric properties validated using three approaches: (1) generating the item pool through literature research and focus group discussions; (2) assessing the items through expert consultation; and (3) evaluating construct validity, content validity, and internal consistency reliability through exploratory factor analysis (EFA) and confirmatory factor analysis (CFA). Data from a total of 3921 respondents were randomly divided into two subsets, one for EFA (n = 1935) and the other for CFA (n = 1986). A 22-item draft scale with five factors was created after literature research and focus group discussion. The content validity of this scale ranged between 0.88 and 1.00. EFA showed a 17-item scale with four factors (Cronbach’s α > 0.7) accounting for 68.044% of the total variance. CFA showed that the values of the fit indices, including convergent validity and discriminant validity, were excellent or acceptable. The overall Cronbach’s α was 0.874, and each factor ranged from 0.726 to 0.885. This study introduces a valuable tool for assessing vaccination attitudes during public health crises, aiding researchers, policymakers, and nurses in combating vaccine hesitancy. Emphasizing the importance of fostering vaccine acceptance, it enhances disease control during emergencies, contributing to the knowledge needed for more effective public health strategies and crisis responses

Validation of the Quality Analysis of Medical Artificial Intelligence (QAMAI) tool: a new tool to assess the quality of health information provided by AI platforms.

The widespread diffusion of Artificial Intelligence (AI) platforms is revolutionizing how health-related information is disseminated, thereby highlighting the need for tools to evaluate the quality of such information. This study aimed to propose and validate the Quality Assessment of Medical Artificial Intelligence (QAMAI), a tool specifically designed to assess the quality of health information provided by AI platforms. The QAMAI tool has been developed by a panel of experts following guidelines for the development of new questionnaires. A total of 30 responses from ChatGPT4, addressing patient queries, theoretical questions, and clinical head and neck surgery scenarios were assessed by 27 reviewers from 25 academic centers worldwide. Construct validity, internal consistency, inter-rater and test-retest reliability were assessed to validate the tool. The validation was conducted on the basis of 792 assessments for the 30 responses given by ChatGPT4. The results of the exploratory factor analysis revealed a unidimensional structure of the QAMAI with a single factor comprising all the items that explained 51.1% of the variance with factor loadings ranging from 0.449 to 0.856. Overall internal consistency was high (Cronbach's alpha = 0.837). The Interclass Correlation Coefficient was 0.983 (95% CI 0.973-0.991; F (29,542) = 68.3; p < 0.001), indicating excellent reliability. Test-retest reliability analysis revealed a moderate-to-strong correlation with a Pearson's coefficient of 0.876 (95% CI 0.859-0.891; p < 0.001). The QAMAI tool demonstrated significant reliability and validity in assessing the quality of health information provided by AI platforms. Such a tool might become particularly important/useful for physicians as patients increasingly seek medical information on AI platforms.

A Tool for the Assessment of Swallowing Safety and Efficiency in Adults: Turkish Adaptation of Boston Residue and Clearance Scale.

The objective of this study was to create a Turkish language adaptation of the Boston Residue and Clearance Scale (BRACS), a validated and reliable tool. The BRACS scale was first translated into Turkish and a Turkish version was subsequently developed. Fiberoptic endoscopic examination of swallowing (FEES) was administered to collect data from 25 dysphagic patients who were hospitalized after a stroke. The recorded films were subjected to editing procedures to ensure their appropriateness for the assessment of swallowing disorders and were then dispatched to a panel of five speech and language therapists for evaluation using the adaptation of the BRACS instrument. The scoring by the experts was evaluated using both explanatory factor analysis (EFA) and confirmatory factor analysis (CFA). Convergent validity, item reliability, and construct (composite) reliability were measured by calculating the average variance extracted (AVE) values. For the 12 location items, EFA revealed 3 main latent factors: the laryngeal vestibule and the oropharynx and hypopharynx. The Turkish BRACS had excellent inter-rater reliability (Krippendorff's alpha coefficient values ranged from 0.93 to 0.95) and high internal consistency (Cronbach's alpha values ranged from 0.88 to 0.93). Inter-rater ICCs for the first and second sessions were 0.83 and 0.85, respectively. CFA showed that all fitted criteria reached acceptable or perfect fit levels. The findings indicated that the proposed factor structure was validated. The AVE values are between 0.61 and 0.73 which was taken as evidence of convergent validity. The Turkish adaptation of the BRACS tool demonstrates both reliablity and validity, rendering it a useful and credible tool for assessing residual severity, particularly in clinical settings.

Translation, cross-cultural adaptation, and psychometric properties of the Arabic version of the MedRisk instrument for measuring patient satisfaction with physical therapy care

Purpose This study aimed to translate, cross-culturally adapt, and validate the MedRisk Instrument for Measuring Patient Satisfaction with Physical Therapy Care into Arabic (MRPS-Ar). Materials and Methods The 20-Item MRPS was translated and cross-culturally adapted into Arabic following international guidelines. Patients (n = 229) with musculoskeletal conditions who received physical therapy care completed the MRPS-Ar and global rating of change scale. Of these patients, 95 completed the MRPS-Ar twice. Factor structure, floor and ceiling effects, internal consistency, test-retest reliability, and construct validity of the MRPS-Ar were evaluated. Results Principal component analysis suggested 3-factor solution: a 7-item facility experience, 6-item therapeutic experience, and 3-item positive experience. The MRPS-Ar and its factors showed acceptable internal consistency (Cronbach’s alpha coefficients ranged from 0.819 to 0.936) and excellent test-retest reliability (ICCs ranged from 0.965 to 0.983). The global measures of satisfaction were significantly correlated with the global rating of change (Spearman’s rho = −0.678, p < 0.001 for item “overall satisfaction” and Spearman’s rho = −0.690, p < 0.001 for item “would return”). Conclusions The 18-item MRPS-Ar displayed adequate psychometric properties for measuring patients’ satisfaction with physical therapy care. The MRPS-Ar is a reliable and valid instrument that can be used in medical, clinical, and research fields.